Apr 14 14:12:46 user nova-compute[71347]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 14:12:48 user nova-compute[71347]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71347) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 14:12:48 user nova-compute[71347]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71347) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 14:12:48 user nova-compute[71347]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71347) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 14:12:48 user nova-compute[71347]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 14:12:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:12:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:12:48 user nova-compute[71347]: INFO nova.virt.driver [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 14:12:49 user nova-compute[71347]: INFO nova.compute.provider_config [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] Acquiring lock "singleton_lock" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] Acquired lock "singleton_lock" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] Releasing lock "singleton_lock" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] Full set of CONF: {{(pid=71347) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ******************************************************************************** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] Configuration options gathered from: {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ================================================================================ {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] allow_resize_to_same_host      = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] arq_binding_timeout            = 300 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] backdoor_port                  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] backdoor_socket                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] block_device_allocate_retries  = 300 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] block_device_allocate_retries_interval = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cert                           = self.pem {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute_monitors               = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] config_dir                     = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] config_drive_format            = iso9660 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] config_source                  = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] console_host                   = user {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] control_exchange               = nova {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cpu_allocation_ratio           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] daemon                         = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] debug                          = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] default_access_ip_network_name = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] default_availability_zone      = nova {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] default_ephemeral_format       = ext4 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] default_schedule_zone          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] disk_allocation_ratio          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] enable_new_services            = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] enabled_ssl_apis               = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] flat_injected                  = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] force_config_drive             = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] force_raw_images               = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] graceful_shutdown_timeout      = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] heal_instance_info_cache_interval = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] host                           = user {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] instance_build_timeout         = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] instance_delete_interval       = 300 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] instance_name_template         = instance-%08x {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] instance_usage_audit           = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] instance_usage_audit_period    = month {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] internal_service_availability_zone = internal {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] key                            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] live_migration_retry_count     = 30 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] log_config_append              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] log_dir                        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] log_file                       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] log_options                    = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] log_rotate_interval            = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] log_rotate_interval_type       = days {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] log_rotation_type              = none {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] long_rpc_timeout               = 1800 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] max_concurrent_builds          = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] max_concurrent_live_migrations = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] max_concurrent_snapshots       = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] max_local_block_devices        = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] max_logfile_count              = 30 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] max_logfile_size_mb            = 200 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] maximum_instance_delete_attempts = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] metadata_listen                = 0.0.0.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] metadata_listen_port           = 8775 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] metadata_workers               = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] migrate_max_retries            = -1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] mkisofs_cmd                    = genisoimage {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] my_ip                          = 10.0.0.210 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] network_allocate_retries       = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] osapi_compute_listen_port      = 8774 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] osapi_compute_unique_server_name_scope =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] osapi_compute_workers          = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] password_length                = 12 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] periodic_enable                = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] periodic_fuzzy_delay           = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] pointer_model                  = ps2mouse {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] preallocate_images             = none {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] publish_errors                 = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] pybasedir                      = /opt/stack/nova {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ram_allocation_ratio           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] rate_limit_burst               = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] rate_limit_except_level        = CRITICAL {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] rate_limit_interval            = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] reboot_timeout                 = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] reclaim_instance_interval      = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] record                         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] reimage_timeout_per_gb         = 20 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] report_interval                = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] rescue_timeout                 = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] reserved_host_cpus             = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] reserved_host_disk_mb          = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] reserved_host_memory_mb        = 512 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] reserved_huge_pages            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] resize_confirm_window          = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] resize_fs_using_block_device   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] resume_guests_state_on_host_boot = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] rpc_response_timeout           = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] run_external_periodic_tasks    = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] running_deleted_instance_action = reap {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] running_deleted_instance_timeout = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler_instance_sync_interval = 120 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_down_time              = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] servicegroup_driver            = db {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] shelved_offload_time           = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] shelved_poll_interval          = 3600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] shutdown_timeout               = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] source_is_ipv6                 = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ssl_only                       = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] state_path                     = /opt/stack/data/nova {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] sync_power_state_interval      = 600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] sync_power_state_pool_size     = 1000 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] syslog_log_facility            = LOG_USER {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] tempdir                        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] timeout_nbd                    = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] transport_url                  = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] update_resources_interval      = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] use_cow_images                 = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] use_eventlog                   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] use_journal                    = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] use_json                       = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] use_rootwrap_daemon            = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] use_stderr                     = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] use_syslog                     = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vcpu_pin_set                   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plugging_is_fatal          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plugging_timeout           = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] virt_mkfs                      = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] volume_usage_poll_interval     = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] watch_log_file                 = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] web                            = /usr/share/spice-html5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.auth_strategy              = keystone {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.compute_link_prefix        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.dhcp_domain                = novalocal {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.enable_instance_password   = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.glance_link_prefix         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.instance_list_per_project_cells = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.list_records_by_skipping_down_cells = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.local_metadata_per_cell    = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.max_limit                  = 1000 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.metadata_cache_expiration  = 15 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.neutron_default_tenant_id  = default {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.use_forwarded_for          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.use_neutron_default_nets   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.vendordata_dynamic_targets = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.vendordata_jsonfile_path   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.backend_argument         = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.config_prefix            = cache.oslo {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.dead_timeout             = 60.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.debug_cache_backend      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.enable_retry_client      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.enable_socket_keepalive  = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.enabled                  = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.expiration_time          = 600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_dead_retry      = 300 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_password        =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_sasl_enabled    = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.memcache_username        =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.proxies                  = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.retry_attempts           = 2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.retry_delay              = 0.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.socket_keepalive_count   = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.socket_keepalive_idle    = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.socket_keepalive_interval = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.tls_allowed_ciphers      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.tls_cafile               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.tls_certfile             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.tls_enabled              = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cache.tls_keyfile              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.auth_section            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.auth_type               = password {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.cafile                  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.certfile                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.collect_timing          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.cross_az_attach         = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.debug                   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.endpoint_template       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.http_retries            = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.insecure                = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.keyfile                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.os_region_name          = RegionOne {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.split_loggers           = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cinder.timeout                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.cpu_dedicated_set      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.cpu_shared_set         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.image_type_exclude_list = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.resource_provider_association_refresh = 300 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.shutdown_retry_interval = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] conductor.workers              = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] console.allowed_origins        = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] console.ssl_ciphers            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] console.ssl_minimum_version    = default {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] consoleauth.token_ttl          = 600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.cafile                  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.certfile                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.collect_timing          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.connect_retries         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.connect_retry_delay     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.endpoint_override       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.insecure                = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.keyfile                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.max_version             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.min_version             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.region_name             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.service_name            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.service_type            = accelerator {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.split_loggers           = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.status_code_retries     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.status_code_retry_delay = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.timeout                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] cyborg.version                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.backend               = sqlalchemy {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.connection            = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.connection_debug      = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.connection_parameters =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.connection_recycle_time = 3600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.connection_trace      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.db_inc_retry_interval = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.db_max_retries        = 20 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.db_max_retry_interval = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.db_retry_interval     = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.max_overflow          = 50 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.max_pool_size         = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.max_retries           = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.mysql_enable_ndb      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.pool_timeout          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.retry_interval        = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.slave_connection      = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] database.sqlite_synchronous    = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.backend           = sqlalchemy {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.connection        = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.connection_debug  = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.connection_parameters =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.connection_recycle_time = 3600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.connection_trace  = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.db_inc_retry_interval = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.db_max_retries    = 20 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.db_max_retry_interval = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.db_retry_interval = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.max_overflow      = 50 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.max_pool_size     = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.max_retries       = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.mysql_enable_ndb  = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.pool_timeout      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.retry_interval    = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.slave_connection  = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] api_database.sqlite_synchronous = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] devices.enabled_mdev_types     = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ephemeral_storage_encryption.enabled = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.api_servers             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.cafile                  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.certfile                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.collect_timing          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.connect_retries         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.connect_retry_delay     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.debug                   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.default_trusted_certificate_ids = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.enable_certificate_validation = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.enable_rbd_download     = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.endpoint_override       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.insecure                = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.keyfile                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.max_version             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.min_version             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.num_retries             = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.rbd_ceph_conf           =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.rbd_connect_timeout     = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.rbd_pool                =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.rbd_user                =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.region_name             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.service_name            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.service_type            = image {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.split_loggers           = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.status_code_retries     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.status_code_retry_delay = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.timeout                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.verify_glance_signatures = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] glance.version                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] guestfs.debug                  = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.config_drive_cdrom      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.config_drive_inject_password = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.enable_remotefx         = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.instances_path_share    =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.limit_cpu_features      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.use_multipath_io        = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.vswitch_name            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] mks.enabled                    = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] image_cache.manager_interval   = 2400 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] image_cache.precache_concurrency = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] image_cache.remove_unused_base_images = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] image_cache.subdirectory_name  = _base {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.api_max_retries         = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.api_retry_interval      = 2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.auth_section            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.auth_type               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.cafile                  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.certfile                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.collect_timing          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.connect_retries         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.connect_retry_delay     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.endpoint_override       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.insecure                = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.keyfile                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.max_version             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.min_version             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.partition_key           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.peer_list               = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.region_name             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.serial_console_state_timeout = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.service_name            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.service_type            = baremetal {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.split_loggers           = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.status_code_retries     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.status_code_retry_delay = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.timeout                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ironic.version                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] key_manager.fixed_key          = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.barbican_api_version  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.barbican_endpoint     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.barbican_endpoint_type = public {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.barbican_region_name  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.cafile                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.certfile              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.collect_timing        = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.insecure              = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.keyfile               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.number_of_retries     = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.retry_delay           = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.send_service_user_token = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.split_loggers         = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.timeout               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.verify_ssl            = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican.verify_ssl_path       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.auth_section = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.auth_type = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.cafile   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.certfile = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.collect_timing = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.insecure = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.keyfile  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.split_loggers = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] barbican_service_user.timeout  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.approle_role_id          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.approle_secret_id        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.cafile                   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.certfile                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.collect_timing           = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.insecure                 = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.keyfile                  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.kv_mountpoint            = secret {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.kv_version               = 2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.namespace                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.root_token_id            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.split_loggers            = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.ssl_ca_crt_file          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.timeout                  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.use_ssl                  = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.cafile                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.certfile              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.collect_timing        = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.connect_retries       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.connect_retry_delay   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.endpoint_override     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.insecure              = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.keyfile               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.max_version           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.min_version           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.region_name           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.service_name          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.service_type          = identity {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.split_loggers         = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.status_code_retries   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.status_code_retry_delay = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.timeout               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] keystone.version               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.connection_uri         =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.cpu_mode               = custom {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: WARNING oslo_config.cfg [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.cpu_power_governor_high = performance {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.cpu_power_management   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.device_detach_attempts = 8 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.device_detach_timeout  = 20 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.disk_cachemodes        = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.disk_prefix            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.enabled_perf_events    = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.file_backed_memory     = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.gid_maps               = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.hw_disk_discard        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.hw_machine_type        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.images_rbd_pool        = rbd {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.images_type            = default {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.images_volume_group    = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.inject_key             = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.inject_partition       = -2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.inject_password        = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.iscsi_iface            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.iser_use_multipath     = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_downtime = 500 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_inbound_addr = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_scheme  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_timeout_action = abort {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_tunnelled = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: WARNING oslo_config.cfg [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 14:12:49 user nova-compute[71347]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 14:12:49 user nova-compute[71347]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 14:12:49 user nova-compute[71347]: and ``live_migration_inbound_addr`` respectively.
Apr 14 14:12:49 user nova-compute[71347]: ).  Its value may be silently ignored in the future.
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.live_migration_with_native_tls = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.max_queues             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.nfs_mount_options      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.num_pcie_ports         = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.pmem_namespaces        = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.quobyte_client_cfg     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rbd_secret_uuid        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rbd_user               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rescue_image_id        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rescue_kernel_id       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.rx_queue_size          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.smbfs_mount_options    =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.snapshot_compression   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.snapshot_image_format  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.sparse_logical_volumes = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.swtpm_enabled          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.swtpm_group            = tss {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.swtpm_user             = tss {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.sysinfo_serial         = unique {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.tx_queue_size          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.uid_maps               = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.use_virtio_for_bridges = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.virt_type              = kvm {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.volume_clear           = zero {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.volume_clear_size      = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.volume_use_multipath   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.vzstorage_cache_path   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.auth_section           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.auth_type              = password {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.cafile                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.certfile               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.collect_timing         = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.connect_retries        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.connect_retry_delay    = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.default_floating_pool  = public {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.endpoint_override      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.extension_sync_interval = 600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.http_retries           = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.insecure               = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.keyfile                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.max_version            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.min_version            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.ovs_bridge             = br-int {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.physnets               = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.region_name            = RegionOne {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.service_metadata_proxy = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.service_name           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.service_type           = network {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.split_loggers          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.status_code_retries    = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.status_code_retry_delay = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.timeout                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] neutron.version                = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] notifications.bdms_in_notifications = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] notifications.default_level    = INFO {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] notifications.notification_format = unversioned {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] notifications.notify_on_state_change = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] pci.alias                      = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] pci.device_spec                = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] pci.report_in_placement        = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.auth_section         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.auth_type            = password {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.cafile               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.certfile             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.collect_timing       = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.connect_retries      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.connect_retry_delay  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.default_domain_id    = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.default_domain_name  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.domain_id            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.domain_name          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.endpoint_override    = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.insecure             = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.keyfile              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.max_version          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.min_version          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.password             = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.project_domain_id    = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.project_domain_name  = Default {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.project_id           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.project_name         = service {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.region_name          = RegionOne {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.service_name         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.service_type         = placement {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.split_loggers        = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.status_code_retries  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.status_code_retry_delay = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.system_scope         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.timeout              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.trust_id             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.user_domain_id       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.user_domain_name     = Default {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.user_id              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.username             = placement {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] placement.version              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.cores                    = 20 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.count_usage_from_placement = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.injected_file_content_bytes = 10240 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.injected_file_path_length = 255 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.injected_files           = 5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.instances                = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.key_pairs                = 100 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.metadata_items           = 128 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.ram                      = 51200 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.recheck_quota            = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.server_group_members     = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] quota.server_groups            = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] rdp.enabled                    = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.image_metadata_prefilter = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.max_attempts         = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.max_placement_results = 1000 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] scheduler.workers              = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.host_subset_size = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.isolated_hosts = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.isolated_images = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.pci_in_placement = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.track_instance_changes = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] metrics.required               = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] metrics.weight_multiplier      = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] metrics.weight_setting         = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] serial_console.enabled         = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] serial_console.port_range      = 10000:20000 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] serial_console.serialproxy_port = 6083 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.auth_section      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.auth_type         = password {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.cafile            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.certfile          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.collect_timing    = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.insecure          = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.keyfile           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.send_service_user_token = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.split_loggers     = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] service_user.timeout           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.agent_enabled            = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.enabled                  = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.html5proxy_port          = 6082 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.image_compression        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.jpeg_compression         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.playback_compression     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.server_listen            = 127.0.0.1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.streaming_mode           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] spice.zlib_compression         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] upgrade_levels.baseapi         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] upgrade_levels.cert            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] upgrade_levels.compute         = auto {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] upgrade_levels.conductor       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] upgrade_levels.scheduler       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.cafile = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.certfile = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.insecure = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vendordata_dynamic_auth.timeout = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.api_retry_count         = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.ca_file                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.cache_prefix            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.cluster_name            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.connection_pool_size    = 10 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.console_delay_seconds   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.datastore_regex         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.host_ip                 = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.host_password           = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.host_port               = 443 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.host_username           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.insecure                = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.integration_bridge      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.maximum_objects         = 100 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.pbm_default_policy      = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.pbm_enabled             = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.pbm_wsdl_location       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.serial_port_proxy_uri   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.serial_port_service_uri = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.task_poll_interval      = 0.5 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.use_linked_clone        = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.vnc_keymap              = en-us {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.vnc_port                = 5900 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vmware.vnc_port_total          = 10000 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.auth_schemes               = ['none'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.enabled                    = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.novncproxy_port            = 6080 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.vencrypt_ca_certs          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.vencrypt_client_cert       = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vnc.vencrypt_client_key        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.disable_rootwrap   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.enable_numa_live_migration = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.libvirt_disable_apic = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.client_socket_timeout     = 900 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.default_pool_size         = 1000 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.keep_alive                = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.max_header_line           = 16384 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.ssl_ca_file               = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.ssl_cert_file             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.ssl_key_file              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.tcp_keepidle              = 600 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] zvm.ca_file                    = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] zvm.cloud_connector_url        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] zvm.reachable_timeout          = 300 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.enforce_new_defaults = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.enforce_scope      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.policy_default_rule = default {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.connection_string     = messaging:// {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.enabled               = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.es_doc_type           = notification {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.es_scroll_size        = 10000 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.es_scroll_time        = 2m {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.filter_error_trace    = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.sentinel_service_name = mymaster {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.socket_timeout        = 0.1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] profiler.trace_sqlalchemy      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] remote_debug.host              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] remote_debug.port              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.auth_section        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.auth_type           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.cafile              = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.certfile            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.collect_timing      = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.connect_retries     = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.connect_retry_delay = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.endpoint_id         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.endpoint_override   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.insecure            = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.keyfile             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.max_version         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.min_version         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.region_name         = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.service_name        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.service_type        = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.split_loggers       = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.status_code_retries = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.status_code_retry_delay = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.timeout             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.valid_interfaces    = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_limit.version             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_reports.file_event_handler = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] oslo_reports.log_dir           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_ovs_privileged.group  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] vif_plug_ovs_privileged.user   = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_ovs.isolate_vif         = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] os_brick.lock_path             = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] privsep_osbrick.capabilities   = [21] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] privsep_osbrick.group          = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] privsep_osbrick.helper_command = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] privsep_osbrick.user           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] nova_sys_admin.group           = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] nova_sys_admin.helper_command  = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] nova_sys_admin.user            = None {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG oslo_service.service [None req-8a93818c-4c9d-4f43-a335-2603c20bc3f7 None None] ******************************************************************************** {{(pid=71347) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 14:12:49 user nova-compute[71347]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 14:12:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Starting native event thread {{(pid=71347) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Starting green dispatch thread {{(pid=71347) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Starting connection event dispatch thread {{(pid=71347) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Connecting to libvirt: qemu:///system {{(pid=71347) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4fff7c66b0> {{(pid=71347) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 14:12:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4fff7c66b0> {{(pid=71347) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 14:12:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Connection event '1' reason 'None'
Apr 14 14:12:49 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 14:12:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.mount [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Initialising _HostMountState generation 0 {{(pid=71347) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 14:12:56 user nova-compute[71347]: INFO nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host capabilities <capabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <host>
Apr 14 14:12:56 user nova-compute[71347]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 14:12:56 user nova-compute[71347]:     <cpu>
Apr 14 14:12:56 user nova-compute[71347]:       <arch>x86_64</arch>
Apr 14 14:12:56 user nova-compute[71347]:       <model>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <microcode version='1070'/>
Apr 14 14:12:56 user nova-compute[71347]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 14:12:56 user nova-compute[71347]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='osxsave'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='invtsc'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='rsba'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 14:12:56 user nova-compute[71347]:       <pages unit='KiB' size='4'/>
Apr 14 14:12:56 user nova-compute[71347]:       <pages unit='KiB' size='2048'/>
Apr 14 14:12:56 user nova-compute[71347]:     </cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <power_management>
Apr 14 14:12:56 user nova-compute[71347]:       <suspend_mem/>
Apr 14 14:12:56 user nova-compute[71347]:       <suspend_disk/>
Apr 14 14:12:56 user nova-compute[71347]:       <suspend_hybrid/>
Apr 14 14:12:56 user nova-compute[71347]:     </power_management>
Apr 14 14:12:56 user nova-compute[71347]:     <iommu support='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <migration_features>
Apr 14 14:12:56 user nova-compute[71347]:       <live/>
Apr 14 14:12:56 user nova-compute[71347]:       <uri_transports>
Apr 14 14:12:56 user nova-compute[71347]:         <uri_transport>tcp</uri_transport>
Apr 14 14:12:56 user nova-compute[71347]:         <uri_transport>rdma</uri_transport>
Apr 14 14:12:56 user nova-compute[71347]:       </uri_transports>
Apr 14 14:12:56 user nova-compute[71347]:     </migration_features>
Apr 14 14:12:56 user nova-compute[71347]:     <topology>
Apr 14 14:12:56 user nova-compute[71347]:       <cells num='2'>
Apr 14 14:12:56 user nova-compute[71347]:         <cell id='0'>
Apr 14 14:12:56 user nova-compute[71347]:           <memory unit='KiB'>8189224</memory>
Apr 14 14:12:56 user nova-compute[71347]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 14 14:12:56 user nova-compute[71347]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 14:12:56 user nova-compute[71347]:           <distances>
Apr 14 14:12:56 user nova-compute[71347]:             <sibling id='0' value='10'/>
Apr 14 14:12:56 user nova-compute[71347]:             <sibling id='1' value='20'/>
Apr 14 14:12:56 user nova-compute[71347]:           </distances>
Apr 14 14:12:56 user nova-compute[71347]:           <cpus num='6'>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 14:12:56 user nova-compute[71347]:           </cpus>
Apr 14 14:12:56 user nova-compute[71347]:         </cell>
Apr 14 14:12:56 user nova-compute[71347]:         <cell id='1'>
Apr 14 14:12:56 user nova-compute[71347]:           <memory unit='KiB'>8218764</memory>
Apr 14 14:12:56 user nova-compute[71347]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 14 14:12:56 user nova-compute[71347]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 14:12:56 user nova-compute[71347]:           <distances>
Apr 14 14:12:56 user nova-compute[71347]:             <sibling id='0' value='20'/>
Apr 14 14:12:56 user nova-compute[71347]:             <sibling id='1' value='10'/>
Apr 14 14:12:56 user nova-compute[71347]:           </distances>
Apr 14 14:12:56 user nova-compute[71347]:           <cpus num='6'>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 14:12:56 user nova-compute[71347]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 14:12:56 user nova-compute[71347]:           </cpus>
Apr 14 14:12:56 user nova-compute[71347]:         </cell>
Apr 14 14:12:56 user nova-compute[71347]:       </cells>
Apr 14 14:12:56 user nova-compute[71347]:     </topology>
Apr 14 14:12:56 user nova-compute[71347]:     <cache>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 14:12:56 user nova-compute[71347]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 14:12:56 user nova-compute[71347]:     </cache>
Apr 14 14:12:56 user nova-compute[71347]:     <secmodel>
Apr 14 14:12:56 user nova-compute[71347]:       <model>apparmor</model>
Apr 14 14:12:56 user nova-compute[71347]:       <doi>0</doi>
Apr 14 14:12:56 user nova-compute[71347]:     </secmodel>
Apr 14 14:12:56 user nova-compute[71347]:     <secmodel>
Apr 14 14:12:56 user nova-compute[71347]:       <model>dac</model>
Apr 14 14:12:56 user nova-compute[71347]:       <doi>0</doi>
Apr 14 14:12:56 user nova-compute[71347]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 14:12:56 user nova-compute[71347]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 14:12:56 user nova-compute[71347]:     </secmodel>
Apr 14 14:12:56 user nova-compute[71347]:   </host>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='alpha'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>clipper</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='armv6l'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>spitz</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>nuri</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>kzm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sx1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>z2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>tosa</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>n810</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>n800</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>terrier</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>midway</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>microbit</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>verdex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>highbank</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>akita</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>connex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>collie</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='armv7l'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>spitz</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>nuri</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>kzm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sx1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>z2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>tosa</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>n810</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>n800</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>terrier</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>midway</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>microbit</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>verdex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>highbank</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>akita</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>connex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>collie</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='aarch64'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>spitz</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>nuri</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>kzm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sx1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>z2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>tosa</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>n810</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>n800</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>terrier</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>midway</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>microbit</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>verdex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>highbank</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>akita</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>connex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>collie</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <acpi default='on' toggle='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='cris'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='i686'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>isapc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>microvm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='kvm'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <pae/>
Apr 14 14:12:56 user nova-compute[71347]:       <nonpae/>
Apr 14 14:12:56 user nova-compute[71347]:       <acpi default='on' toggle='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:       <apic default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='m68k'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>an5206</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>q800</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='microblaze'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='microblazeel'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='mips'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='16'>malta</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='mipsel'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='16'>malta</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='mips64'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='16'>malta</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>pica61</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>magnum</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='mips64el'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='16'>malta</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>pica61</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>magnum</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='16'>boston</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='ppc'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mac99</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>40p</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>taihu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='ppc64'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>taihu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>40p</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mac99</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='ppc64le'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>taihu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>40p</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>mac99</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='riscv32'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='8'>spike</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='8'>virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='riscv64'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='8'>spike</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='8'>virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='s390x'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='sh4'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>shix</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>r2d</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='sh4eb'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>shix</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>r2d</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='sparc'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>LX</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='sparc64'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>niagara</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='x86_64'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>64</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='1'>isapc</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>microvm</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='kvm'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <acpi default='on' toggle='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:       <apic default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='xtensa'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>sim</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>kc705</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>ml605</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>lx200</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>lx60</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]:   <guest>
Apr 14 14:12:56 user nova-compute[71347]:     <os_type>hvm</os_type>
Apr 14 14:12:56 user nova-compute[71347]:     <arch name='xtensaeb'>
Apr 14 14:12:56 user nova-compute[71347]:       <wordsize>32</wordsize>
Apr 14 14:12:56 user nova-compute[71347]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='4'>sim</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>kc705</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>ml605</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>virt</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>lx200</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>lx60</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 14:12:56 user nova-compute[71347]:       <domain type='qemu'/>
Apr 14 14:12:56 user nova-compute[71347]:     </arch>
Apr 14 14:12:56 user nova-compute[71347]:     <features>
Apr 14 14:12:56 user nova-compute[71347]:       <cpuselection/>
Apr 14 14:12:56 user nova-compute[71347]:       <deviceboot/>
Apr 14 14:12:56 user nova-compute[71347]:       <disksnapshot default='on' toggle='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     </features>
Apr 14 14:12:56 user nova-compute[71347]:   </guest>
Apr 14 14:12:56 user nova-compute[71347]: </capabilities>
Apr 14 14:12:56 user nova-compute[71347]: 
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 14:12:56 user nova-compute[71347]: <domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 14:12:56 user nova-compute[71347]:   <domain>kvm</domain>
Apr 14 14:12:56 user nova-compute[71347]:   <machine>pc-i440fx-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:   <arch>i686</arch>
Apr 14 14:12:56 user nova-compute[71347]:   <vcpu max='255'/>
Apr 14 14:12:56 user nova-compute[71347]:   <iothreads supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:   <os supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='firmware'/>
Apr 14 14:12:56 user nova-compute[71347]:     <loader supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>rom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pflash</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='readonly'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='secure'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </loader>
Apr 14 14:12:56 user nova-compute[71347]:   </os>
Apr 14 14:12:56 user nova-compute[71347]:   <cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-passthrough' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='hostPassthroughMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='maximum' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='maximumMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-model' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='umip'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibpb'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibrs'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='erms'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='lm'/>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='custom' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>qemu64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>qemu32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>phenom</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>n270</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>kvm64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>coreduo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>core2duo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>athlon</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Westmere</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Snowridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Penryn</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G5</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G4</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G1</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Rome</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Milan</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Dhyana</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cooperlake</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Conroe</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>486</model>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:   </cpu>
Apr 14 14:12:56 user nova-compute[71347]:   <memoryBacking supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='sourceType'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>file</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>anonymous</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>memfd</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:   </memoryBacking>
Apr 14 14:12:56 user nova-compute[71347]:   <devices>
Apr 14 14:12:56 user nova-compute[71347]:     <disk supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='diskDevice'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>disk</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cdrom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>floppy</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>lun</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='bus'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ide</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>fdc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sata</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </disk>
Apr 14 14:12:56 user nova-compute[71347]:     <graphics supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sdl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vnc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>spice</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egl-headless</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </graphics>
Apr 14 14:12:56 user nova-compute[71347]:     <video supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='modelType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cirrus</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vmvga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>qxl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>none</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>bochs</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ramfb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </video>
Apr 14 14:12:56 user nova-compute[71347]:     <hostdev supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='mode'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>subsystem</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='startupPolicy'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>default</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>mandatory</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>requisite</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>optional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='subsysType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pci</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='capsType'/>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='pciBackend'/>
Apr 14 14:12:56 user nova-compute[71347]:     </hostdev>
Apr 14 14:12:56 user nova-compute[71347]:     <rng supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>random</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egd</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>builtin</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </rng>
Apr 14 14:12:56 user nova-compute[71347]:     <filesystem supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='driverType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>path</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>handle</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtiofs</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </filesystem>
Apr 14 14:12:56 user nova-compute[71347]:     <tpm supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-tis</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-crb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>passthrough</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>emulator</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </tpm>
Apr 14 14:12:56 user nova-compute[71347]:   </devices>
Apr 14 14:12:56 user nova-compute[71347]:   <features>
Apr 14 14:12:56 user nova-compute[71347]:     <gic supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <vmcoreinfo supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <genid supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backingStoreInput supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backup supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <sev supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:   </features>
Apr 14 14:12:56 user nova-compute[71347]: </domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 14:12:56 user nova-compute[71347]: <domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 14:12:56 user nova-compute[71347]:   <domain>kvm</domain>
Apr 14 14:12:56 user nova-compute[71347]:   <machine>pc-q35-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:   <arch>i686</arch>
Apr 14 14:12:56 user nova-compute[71347]:   <vcpu max='288'/>
Apr 14 14:12:56 user nova-compute[71347]:   <iothreads supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:   <os supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='firmware'/>
Apr 14 14:12:56 user nova-compute[71347]:     <loader supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>rom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pflash</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='readonly'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='secure'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </loader>
Apr 14 14:12:56 user nova-compute[71347]:   </os>
Apr 14 14:12:56 user nova-compute[71347]:   <cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-passthrough' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='hostPassthroughMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='maximum' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='maximumMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-model' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='umip'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibpb'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibrs'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='erms'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='lm'/>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='custom' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>qemu64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>qemu32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>phenom</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>n270</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>kvm64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>coreduo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>core2duo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>athlon</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Westmere</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Snowridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Penryn</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G5</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G4</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G1</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Rome</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Milan</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Dhyana</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cooperlake</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Conroe</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>486</model>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:   </cpu>
Apr 14 14:12:56 user nova-compute[71347]:   <memoryBacking supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='sourceType'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>file</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>anonymous</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>memfd</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:   </memoryBacking>
Apr 14 14:12:56 user nova-compute[71347]:   <devices>
Apr 14 14:12:56 user nova-compute[71347]:     <disk supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='diskDevice'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>disk</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cdrom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>floppy</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>lun</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='bus'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>fdc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sata</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </disk>
Apr 14 14:12:56 user nova-compute[71347]:     <graphics supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sdl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vnc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>spice</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egl-headless</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </graphics>
Apr 14 14:12:56 user nova-compute[71347]:     <video supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='modelType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cirrus</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vmvga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>qxl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>none</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>bochs</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ramfb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </video>
Apr 14 14:12:56 user nova-compute[71347]:     <hostdev supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='mode'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>subsystem</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='startupPolicy'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>default</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>mandatory</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>requisite</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>optional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='subsysType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pci</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='capsType'/>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='pciBackend'/>
Apr 14 14:12:56 user nova-compute[71347]:     </hostdev>
Apr 14 14:12:56 user nova-compute[71347]:     <rng supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>random</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egd</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>builtin</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </rng>
Apr 14 14:12:56 user nova-compute[71347]:     <filesystem supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='driverType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>path</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>handle</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtiofs</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </filesystem>
Apr 14 14:12:56 user nova-compute[71347]:     <tpm supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-tis</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-crb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>passthrough</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>emulator</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </tpm>
Apr 14 14:12:56 user nova-compute[71347]:   </devices>
Apr 14 14:12:56 user nova-compute[71347]:   <features>
Apr 14 14:12:56 user nova-compute[71347]:     <gic supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <vmcoreinfo supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <genid supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backingStoreInput supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backup supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <sev supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:   </features>
Apr 14 14:12:56 user nova-compute[71347]: </domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 14:12:56 user nova-compute[71347]: <domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 14:12:56 user nova-compute[71347]:   <domain>kvm</domain>
Apr 14 14:12:56 user nova-compute[71347]:   <machine>pc-i440fx-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:   <arch>i686</arch>
Apr 14 14:12:56 user nova-compute[71347]:   <vcpu max='255'/>
Apr 14 14:12:56 user nova-compute[71347]:   <iothreads supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:   <os supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='firmware'/>
Apr 14 14:12:56 user nova-compute[71347]:     <loader supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>rom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pflash</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='readonly'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='secure'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </loader>
Apr 14 14:12:56 user nova-compute[71347]:   </os>
Apr 14 14:12:56 user nova-compute[71347]:   <cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-passthrough' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='hostPassthroughMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='maximum' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='maximumMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-model' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='umip'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibpb'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibrs'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='erms'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='lm'/>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='custom' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>qemu64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>qemu32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>phenom</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>n270</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>kvm64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>coreduo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>core2duo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>athlon</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Westmere</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Snowridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Penryn</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G5</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G4</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G1</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Rome</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Milan</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Dhyana</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cooperlake</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Conroe</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>486</model>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:   </cpu>
Apr 14 14:12:56 user nova-compute[71347]:   <memoryBacking supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='sourceType'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>file</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>anonymous</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>memfd</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:   </memoryBacking>
Apr 14 14:12:56 user nova-compute[71347]:   <devices>
Apr 14 14:12:56 user nova-compute[71347]:     <disk supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='diskDevice'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>disk</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cdrom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>floppy</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>lun</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='bus'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ide</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>fdc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sata</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </disk>
Apr 14 14:12:56 user nova-compute[71347]:     <graphics supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sdl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vnc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>spice</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egl-headless</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </graphics>
Apr 14 14:12:56 user nova-compute[71347]:     <video supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='modelType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cirrus</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vmvga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>qxl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>none</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>bochs</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ramfb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </video>
Apr 14 14:12:56 user nova-compute[71347]:     <hostdev supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='mode'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>subsystem</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='startupPolicy'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>default</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>mandatory</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>requisite</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>optional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='subsysType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pci</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='capsType'/>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='pciBackend'/>
Apr 14 14:12:56 user nova-compute[71347]:     </hostdev>
Apr 14 14:12:56 user nova-compute[71347]:     <rng supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>random</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egd</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>builtin</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </rng>
Apr 14 14:12:56 user nova-compute[71347]:     <filesystem supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='driverType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>path</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>handle</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtiofs</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </filesystem>
Apr 14 14:12:56 user nova-compute[71347]:     <tpm supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-tis</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-crb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>passthrough</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>emulator</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </tpm>
Apr 14 14:12:56 user nova-compute[71347]:   </devices>
Apr 14 14:12:56 user nova-compute[71347]:   <features>
Apr 14 14:12:56 user nova-compute[71347]:     <gic supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <vmcoreinfo supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <genid supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backingStoreInput supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backup supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <sev supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:   </features>
Apr 14 14:12:56 user nova-compute[71347]: </domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 14:12:56 user nova-compute[71347]: <domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 14:12:56 user nova-compute[71347]:   <domain>kvm</domain>
Apr 14 14:12:56 user nova-compute[71347]:   <machine>pc-q35-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:   <arch>i686</arch>
Apr 14 14:12:56 user nova-compute[71347]:   <vcpu max='288'/>
Apr 14 14:12:56 user nova-compute[71347]:   <iothreads supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:   <os supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='firmware'/>
Apr 14 14:12:56 user nova-compute[71347]:     <loader supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>rom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pflash</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='readonly'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='secure'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </loader>
Apr 14 14:12:56 user nova-compute[71347]:   </os>
Apr 14 14:12:56 user nova-compute[71347]:   <cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-passthrough' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='hostPassthroughMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='maximum' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='maximumMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-model' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='umip'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibpb'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibrs'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='erms'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='lm'/>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='custom' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>qemu64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>qemu32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>phenom</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>n270</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>kvm64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>coreduo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>core2duo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>athlon</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Westmere</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Snowridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Penryn</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G5</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G4</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G1</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Rome</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Milan</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Dhyana</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cooperlake</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Conroe</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>486</model>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:   </cpu>
Apr 14 14:12:56 user nova-compute[71347]:   <memoryBacking supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='sourceType'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>file</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>anonymous</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>memfd</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:   </memoryBacking>
Apr 14 14:12:56 user nova-compute[71347]:   <devices>
Apr 14 14:12:56 user nova-compute[71347]:     <disk supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='diskDevice'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>disk</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cdrom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>floppy</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>lun</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='bus'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>fdc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sata</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </disk>
Apr 14 14:12:56 user nova-compute[71347]:     <graphics supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sdl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vnc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>spice</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egl-headless</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </graphics>
Apr 14 14:12:56 user nova-compute[71347]:     <video supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='modelType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cirrus</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vmvga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>qxl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>none</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>bochs</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ramfb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </video>
Apr 14 14:12:56 user nova-compute[71347]:     <hostdev supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='mode'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>subsystem</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='startupPolicy'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>default</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>mandatory</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>requisite</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>optional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='subsysType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pci</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='capsType'/>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='pciBackend'/>
Apr 14 14:12:56 user nova-compute[71347]:     </hostdev>
Apr 14 14:12:56 user nova-compute[71347]:     <rng supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>random</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egd</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>builtin</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </rng>
Apr 14 14:12:56 user nova-compute[71347]:     <filesystem supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='driverType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>path</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>handle</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtiofs</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </filesystem>
Apr 14 14:12:56 user nova-compute[71347]:     <tpm supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-tis</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-crb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>passthrough</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>emulator</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </tpm>
Apr 14 14:12:56 user nova-compute[71347]:   </devices>
Apr 14 14:12:56 user nova-compute[71347]:   <features>
Apr 14 14:12:56 user nova-compute[71347]:     <gic supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <vmcoreinfo supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <genid supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backingStoreInput supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backup supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <sev supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:   </features>
Apr 14 14:12:56 user nova-compute[71347]: </domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 14:12:56 user nova-compute[71347]: <domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 14:12:56 user nova-compute[71347]:   <domain>kvm</domain>
Apr 14 14:12:56 user nova-compute[71347]:   <machine>pc-i440fx-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:   <arch>x86_64</arch>
Apr 14 14:12:56 user nova-compute[71347]:   <vcpu max='255'/>
Apr 14 14:12:56 user nova-compute[71347]:   <iothreads supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:   <os supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='firmware'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>efi</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:     <loader supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>rom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pflash</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='readonly'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='secure'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </loader>
Apr 14 14:12:56 user nova-compute[71347]:   </os>
Apr 14 14:12:56 user nova-compute[71347]:   <cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-passthrough' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='hostPassthroughMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='maximum' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='maximumMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-model' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='umip'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='invtsc'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibpb'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibrs'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='rsba'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='erms'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='custom' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>qemu64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>qemu32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>phenom</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>n270</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>coreduo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>core2duo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>athlon</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Westmere</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Snowridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Penryn</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G5</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G4</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Opteron_G1</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Rome</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Milan</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Dhyana</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cooperlake</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Conroe</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>486</model>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:   </cpu>
Apr 14 14:12:56 user nova-compute[71347]:   <memoryBacking supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='sourceType'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>file</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>anonymous</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>memfd</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:   </memoryBacking>
Apr 14 14:12:56 user nova-compute[71347]:   <devices>
Apr 14 14:12:56 user nova-compute[71347]:     <disk supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='diskDevice'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>disk</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cdrom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>floppy</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>lun</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='bus'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ide</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>fdc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sata</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </disk>
Apr 14 14:12:56 user nova-compute[71347]:     <graphics supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sdl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vnc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>spice</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egl-headless</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </graphics>
Apr 14 14:12:56 user nova-compute[71347]:     <video supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='modelType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cirrus</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vmvga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>qxl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>none</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>bochs</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ramfb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </video>
Apr 14 14:12:56 user nova-compute[71347]:     <hostdev supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='mode'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>subsystem</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='startupPolicy'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>default</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>mandatory</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>requisite</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>optional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='subsysType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pci</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='capsType'/>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='pciBackend'/>
Apr 14 14:12:56 user nova-compute[71347]:     </hostdev>
Apr 14 14:12:56 user nova-compute[71347]:     <rng supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>random</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egd</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>builtin</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </rng>
Apr 14 14:12:56 user nova-compute[71347]:     <filesystem supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='driverType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>path</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>handle</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtiofs</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </filesystem>
Apr 14 14:12:56 user nova-compute[71347]:     <tpm supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-tis</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-crb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>passthrough</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>emulator</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </tpm>
Apr 14 14:12:56 user nova-compute[71347]:   </devices>
Apr 14 14:12:56 user nova-compute[71347]:   <features>
Apr 14 14:12:56 user nova-compute[71347]:     <gic supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <vmcoreinfo supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <genid supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backingStoreInput supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backup supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <sev supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:   </features>
Apr 14 14:12:56 user nova-compute[71347]: </domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 14:12:56 user nova-compute[71347]: <domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 14:12:56 user nova-compute[71347]:   <domain>kvm</domain>
Apr 14 14:12:56 user nova-compute[71347]:   <machine>pc-q35-6.2</machine>
Apr 14 14:12:56 user nova-compute[71347]:   <arch>x86_64</arch>
Apr 14 14:12:56 user nova-compute[71347]:   <vcpu max='288'/>
Apr 14 14:12:56 user nova-compute[71347]:   <iothreads supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:   <os supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='firmware'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>efi</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:     <loader supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>rom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pflash</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='readonly'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='secure'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </loader>
Apr 14 14:12:56 user nova-compute[71347]:   </os>
Apr 14 14:12:56 user nova-compute[71347]:   <cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-passthrough' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='hostPassthroughMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='maximum' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='maximumMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-model' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='umip'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='invtsc'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibpb'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibrs'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='rsba'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='erms'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='custom' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>qemu64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>qemu32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>phenom</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>n270</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>coreduo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>core2duo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>athlon</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Westmere</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Snowridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Penryn</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G5</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G4</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Opteron_G1</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Rome</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Milan</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Dhyana</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cooperlake</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Conroe</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>486</model>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:   </cpu>
Apr 14 14:12:56 user nova-compute[71347]:   <memoryBacking supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='sourceType'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>file</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>anonymous</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>memfd</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:   </memoryBacking>
Apr 14 14:12:56 user nova-compute[71347]:   <devices>
Apr 14 14:12:56 user nova-compute[71347]:     <disk supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='diskDevice'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>disk</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cdrom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>floppy</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>lun</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='bus'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>fdc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sata</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </disk>
Apr 14 14:12:56 user nova-compute[71347]:     <graphics supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sdl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vnc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>spice</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egl-headless</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </graphics>
Apr 14 14:12:56 user nova-compute[71347]:     <video supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='modelType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cirrus</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vmvga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>qxl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>none</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>bochs</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ramfb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </video>
Apr 14 14:12:56 user nova-compute[71347]:     <hostdev supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='mode'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>subsystem</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='startupPolicy'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>default</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>mandatory</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>requisite</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>optional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='subsysType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pci</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='capsType'/>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='pciBackend'/>
Apr 14 14:12:56 user nova-compute[71347]:     </hostdev>
Apr 14 14:12:56 user nova-compute[71347]:     <rng supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>random</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egd</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>builtin</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </rng>
Apr 14 14:12:56 user nova-compute[71347]:     <filesystem supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='driverType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>path</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>handle</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtiofs</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </filesystem>
Apr 14 14:12:56 user nova-compute[71347]:     <tpm supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-tis</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-crb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>passthrough</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>emulator</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </tpm>
Apr 14 14:12:56 user nova-compute[71347]:   </devices>
Apr 14 14:12:56 user nova-compute[71347]:   <features>
Apr 14 14:12:56 user nova-compute[71347]:     <gic supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <vmcoreinfo supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <genid supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backingStoreInput supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backup supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <sev supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:   </features>
Apr 14 14:12:56 user nova-compute[71347]: </domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 14:12:56 user nova-compute[71347]: <domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 14:12:56 user nova-compute[71347]:   <domain>kvm</domain>
Apr 14 14:12:56 user nova-compute[71347]:   <machine>pc-i440fx-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:   <arch>x86_64</arch>
Apr 14 14:12:56 user nova-compute[71347]:   <vcpu max='255'/>
Apr 14 14:12:56 user nova-compute[71347]:   <iothreads supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:   <os supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='firmware'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>efi</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:     <loader supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>rom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pflash</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='readonly'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='secure'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </loader>
Apr 14 14:12:56 user nova-compute[71347]:   </os>
Apr 14 14:12:56 user nova-compute[71347]:   <cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-passthrough' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='hostPassthroughMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='maximum' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='maximumMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-model' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='umip'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='invtsc'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibpb'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibrs'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='rsba'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='erms'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='custom' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>qemu64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>qemu32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>phenom</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>n270</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>coreduo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>core2duo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>athlon</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Westmere</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Snowridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Penryn</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G5</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G4</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Opteron_G1</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Rome</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Milan</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Dhyana</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cooperlake</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Conroe</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>486</model>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:   </cpu>
Apr 14 14:12:56 user nova-compute[71347]:   <memoryBacking supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='sourceType'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>file</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>anonymous</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>memfd</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:   </memoryBacking>
Apr 14 14:12:56 user nova-compute[71347]:   <devices>
Apr 14 14:12:56 user nova-compute[71347]:     <disk supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='diskDevice'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>disk</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cdrom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>floppy</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>lun</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='bus'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ide</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>fdc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sata</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </disk>
Apr 14 14:12:56 user nova-compute[71347]:     <graphics supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sdl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vnc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>spice</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egl-headless</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </graphics>
Apr 14 14:12:56 user nova-compute[71347]:     <video supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='modelType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cirrus</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vmvga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>qxl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>none</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>bochs</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ramfb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </video>
Apr 14 14:12:56 user nova-compute[71347]:     <hostdev supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='mode'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>subsystem</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='startupPolicy'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>default</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>mandatory</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>requisite</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>optional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='subsysType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pci</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='capsType'/>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='pciBackend'/>
Apr 14 14:12:56 user nova-compute[71347]:     </hostdev>
Apr 14 14:12:56 user nova-compute[71347]:     <rng supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>random</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egd</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>builtin</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </rng>
Apr 14 14:12:56 user nova-compute[71347]:     <filesystem supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='driverType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>path</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>handle</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtiofs</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </filesystem>
Apr 14 14:12:56 user nova-compute[71347]:     <tpm supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-tis</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-crb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>passthrough</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>emulator</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </tpm>
Apr 14 14:12:56 user nova-compute[71347]:   </devices>
Apr 14 14:12:56 user nova-compute[71347]:   <features>
Apr 14 14:12:56 user nova-compute[71347]:     <gic supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <vmcoreinfo supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <genid supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backingStoreInput supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backup supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <sev supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:   </features>
Apr 14 14:12:56 user nova-compute[71347]: </domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 14:12:56 user nova-compute[71347]: <domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 14:12:56 user nova-compute[71347]:   <domain>kvm</domain>
Apr 14 14:12:56 user nova-compute[71347]:   <machine>pc-q35-jammy</machine>
Apr 14 14:12:56 user nova-compute[71347]:   <arch>x86_64</arch>
Apr 14 14:12:56 user nova-compute[71347]:   <vcpu max='288'/>
Apr 14 14:12:56 user nova-compute[71347]:   <iothreads supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:   <os supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='firmware'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>efi</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:     <loader supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>rom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pflash</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='readonly'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='secure'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>yes</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>no</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </loader>
Apr 14 14:12:56 user nova-compute[71347]:   </os>
Apr 14 14:12:56 user nova-compute[71347]:   <cpu>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-passthrough' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='hostPassthroughMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='maximum' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='maximumMigratable'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>on</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>off</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='host-model' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <vendor>Intel</vendor>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ss'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='vmx'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pcid'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='hypervisor'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arat'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='umip'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='md-clear'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='invtsc'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibpb'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='ibrs'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-stibp'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='rsba'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='erms'/>
Apr 14 14:12:56 user nova-compute[71347]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:     <mode name='custom' supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>qemu64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>qemu32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>phenom</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>pentium</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>n270</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm64</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>kvm32</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>coreduo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>core2duo</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>athlon</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Westmere</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Snowridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Skylake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>SandyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Penryn</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G5</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G4</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G3</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Opteron_G2</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Opteron_G1</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>IvyBridge</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Icelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Haswell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Rome</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-Milan</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>EPYC</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Dhyana</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cooperlake</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>Conroe</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='no'>Broadwell</model>
Apr 14 14:12:56 user nova-compute[71347]:       <model usable='yes'>486</model>
Apr 14 14:12:56 user nova-compute[71347]:     </mode>
Apr 14 14:12:56 user nova-compute[71347]:   </cpu>
Apr 14 14:12:56 user nova-compute[71347]:   <memoryBacking supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:     <enum name='sourceType'>
Apr 14 14:12:56 user nova-compute[71347]:       <value>file</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>anonymous</value>
Apr 14 14:12:56 user nova-compute[71347]:       <value>memfd</value>
Apr 14 14:12:56 user nova-compute[71347]:     </enum>
Apr 14 14:12:56 user nova-compute[71347]:   </memoryBacking>
Apr 14 14:12:56 user nova-compute[71347]:   <devices>
Apr 14 14:12:56 user nova-compute[71347]:     <disk supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='diskDevice'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>disk</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cdrom</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>floppy</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>lun</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='bus'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>fdc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sata</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </disk>
Apr 14 14:12:56 user nova-compute[71347]:     <graphics supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='type'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>sdl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vnc</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>spice</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egl-headless</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </graphics>
Apr 14 14:12:56 user nova-compute[71347]:     <video supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='modelType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>cirrus</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>vmvga</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>qxl</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>none</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>bochs</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>ramfb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </video>
Apr 14 14:12:56 user nova-compute[71347]:     <hostdev supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='mode'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>subsystem</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='startupPolicy'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>default</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>mandatory</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>requisite</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>optional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='subsysType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>usb</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>pci</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>scsi</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='capsType'/>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='pciBackend'/>
Apr 14 14:12:56 user nova-compute[71347]:     </hostdev>
Apr 14 14:12:56 user nova-compute[71347]:     <rng supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtio-non-transitional</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>random</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>egd</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>builtin</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </rng>
Apr 14 14:12:56 user nova-compute[71347]:     <filesystem supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='driverType'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>path</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>handle</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>virtiofs</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </filesystem>
Apr 14 14:12:56 user nova-compute[71347]:     <tpm supported='yes'>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='model'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-tis</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>tpm-crb</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:       <enum name='backendModel'>
Apr 14 14:12:56 user nova-compute[71347]:         <value>passthrough</value>
Apr 14 14:12:56 user nova-compute[71347]:         <value>emulator</value>
Apr 14 14:12:56 user nova-compute[71347]:       </enum>
Apr 14 14:12:56 user nova-compute[71347]:     </tpm>
Apr 14 14:12:56 user nova-compute[71347]:   </devices>
Apr 14 14:12:56 user nova-compute[71347]:   <features>
Apr 14 14:12:56 user nova-compute[71347]:     <gic supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:     <vmcoreinfo supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <genid supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backingStoreInput supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <backup supported='yes'/>
Apr 14 14:12:56 user nova-compute[71347]:     <sev supported='no'/>
Apr 14 14:12:56 user nova-compute[71347]:   </features>
Apr 14 14:12:56 user nova-compute[71347]: </domainCapabilities>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71347) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71347) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Checking secure boot support for host arch (x86_64) {{(pid=71347) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Checking secure boot support for host arch (x86_64) {{(pid=71347) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Checking secure boot support for host arch (x86_64) {{(pid=71347) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 14:12:56 user nova-compute[71347]: INFO nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Secure Boot support detected
Apr 14 14:12:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] cpu compare xml: <cpu match="exact">
Apr 14 14:12:56 user nova-compute[71347]:   <model>Nehalem</model>
Apr 14 14:12:56 user nova-compute[71347]: </cpu>
Apr 14 14:12:56 user nova-compute[71347]:  {{(pid=71347) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 14:12:56 user nova-compute[71347]: INFO nova.virt.node [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Generated node identity a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c
Apr 14 14:12:56 user nova-compute[71347]: INFO nova.virt.node [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Wrote node identity a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c to /opt/stack/data/nova/compute_id
Apr 14 14:12:56 user nova-compute[71347]: WARNING nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Compute nodes ['a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 14:12:57 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 14:12:57 user nova-compute[71347]: WARNING nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 14:12:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:12:57 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:12:57 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Hypervisor/Node resource view: name=user free_ram=10809MB free_disk=27.27391815185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:12:57 user nova-compute[71347]: WARNING nova.compute.resource_tracker [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] No compute node record for user:a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c could not be found.
Apr 14 14:12:57 user nova-compute[71347]: INFO nova.compute.resource_tracker [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Compute node record created for user:user with uuid: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:12:57 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [req-5cc7f99a-5d78-4e75-b6f2-f69fa8dedd4e] Created resource provider record via placement API for resource provider with UUID a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c and name user.
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71347) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 14:12:57 user nova-compute[71347]: INFO nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] kernel doesn't support AMD SEV
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Libvirt baseline CPU <cpu>
Apr 14 14:12:57 user nova-compute[71347]:   <arch>x86_64</arch>
Apr 14 14:12:57 user nova-compute[71347]:   <model>Nehalem</model>
Apr 14 14:12:57 user nova-compute[71347]:   <vendor>Intel</vendor>
Apr 14 14:12:57 user nova-compute[71347]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 14:12:57 user nova-compute[71347]: </cpu>
Apr 14 14:12:57 user nova-compute[71347]:  {{(pid=71347) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Updated inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Updating resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c generation from 0 to 1 during operation: update_inventory {{(pid=71347) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:12:57 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Updating resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c generation from 1 to 2 during operation: update_traits {{(pid=71347) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 14:12:58 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:12:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:12:58 user nova-compute[71347]: DEBUG nova.service [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Creating RPC server for service compute {{(pid=71347) start /opt/stack/nova/nova/service.py:182}}
Apr 14 14:12:58 user nova-compute[71347]: DEBUG nova.service [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Join ServiceGroup membership for this service compute {{(pid=71347) start /opt/stack/nova/nova/service.py:199}}
Apr 14 14:12:58 user nova-compute[71347]: DEBUG nova.servicegroup.drivers.db [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71347) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 14:13:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:13:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:13:49 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:13:49 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:13:49 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=10206MB free_disk=27.187759399414062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:13:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:14:49 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:14:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:14:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:14:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=10131MB free_disk=27.234134674072266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:14:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:14:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:14:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:14:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:14:50 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:14:50 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:14:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:14:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:14:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:14:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:15:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:15:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:15:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:15:49 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:15:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:15:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:15:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=10123MB free_disk=27.010112762451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:15:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:15:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:15:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:15:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:15:50 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:15:50 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:15:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:15:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:15:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:15:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:15:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:15:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:15:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:16:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:16:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:16:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:16:49 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:16:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:16:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:16:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=9441MB free_disk=27.041179656982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:16:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:16:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:16:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:16:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:16:50 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:16:50 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:16:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:16:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:16:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:16:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:16:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:16:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:53 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:16:59 user nova-compute[71347]: INFO nova.compute.claims [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Claim successful on node user
Apr 14 14:16:59 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:16:59 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:16:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:16:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Creating image(s)
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG nova.policy [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d.part --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG nova.virt.images [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 79416463-b265-4588-8d03-bcb84f0ecc83 was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d.part /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d.part /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d.converted" returned: 0 in 0.259s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.026s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:01 user nova-compute[71347]: INFO oslo.privsep.daemon [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvvvqctk5/privsep.sock']
Apr 14 14:17:01 user sudo[80061]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvvvqctk5/privsep.sock
Apr 14 14:17:01 user sudo[80061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 14:17:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:01 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:01 user nova-compute[71347]: INFO nova.compute.claims [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Claim successful on node user
Apr 14 14:17:02 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Creating image(s)
Apr 14 14:17:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:02 user sudo[80061]: pam_unix(sudo:session): session closed for user root
Apr 14 14:17:02 user nova-compute[71347]: INFO oslo.privsep.daemon [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Spawned new privsep daemon via rootwrap
Apr 14 14:17:02 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 14:17:02 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 14:17:02 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 14:17:02 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80076
Apr 14 14:17:02 user nova-compute[71347]: WARNING oslo_privsep.priv_context [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] privsep daemon already running
Apr 14 14:17:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk 1073741824" returned: 0 in 0.045s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.183s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.policy [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk 1073741824" returned: 0 in 0.049s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:03 user nova-compute[71347]: INFO nova.compute.claims [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Claim successful on node user
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Cannot resize image /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'migration_context' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Ensure instance console log exists: /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.127s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Cannot resize image /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'migration_context' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Ensure instance console log exists: /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.network.neutron [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:04 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Creating image(s)
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "/opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "/opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk 1073741824" returned: 0 in 0.044s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Cannot resize image /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lazy-loading 'migration_context' on Instance uuid 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Ensure instance console log exists: /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.policy [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6a767acbdff4f65bef46f45d0c745f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e71e69f67a4c44be53fa655a7b50e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Successfully created port: 1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:06 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Successfully created port: 9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:07 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Successfully updated port: 9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquired lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:07 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:07 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.network.neutron [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Successfully created port: 03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-changed-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Refreshing instance network info cache due to event network-changed-9c5ceb2e-307c-4e1c-9356-b14b40e04290. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Acquiring lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:08 user nova-compute[71347]: INFO nova.compute.claims [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Claim successful on node user
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.network.neutron [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Creating image(s)
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "/opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "/opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updating instance_info_cache with network_info: [{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Releasing lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Instance network_info: |[{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Acquired lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.network.neutron [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Refreshing network info cache for port 9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Start _get_guest_xml network_info=[{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:08 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:08 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1496827',display_name='tempest-ServerRescueNegativeTestJSON-server-1496827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1496827',id=2,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-kgeq8ou2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:02Z,user_data=None,user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=7c7956b5-905e-4a1a-b657-fe3aa5018258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:88:c6,bridge_name='br-int',has_traffic_filtering=True,id=9c5ceb2e-307c-4e1c-9356-b14b40e04290,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ceb2e-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:09 user nova-compute[71347]:   <uuid>7c7956b5-905e-4a1a-b657-fe3aa5018258</uuid>
Apr 14 14:17:09 user nova-compute[71347]:   <name>instance-00000002</name>
Apr 14 14:17:09 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:09 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:09 user nova-compute[71347]:   <metadata>
Apr 14 14:17:09 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:09 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:09 user nova-compute[71347]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1496827</nova:name>
Apr 14 14:17:09 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:08</nova:creationTime>
Apr 14 14:17:09 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:09 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:09 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:09 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:09 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:09 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:09 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:09 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:09 user nova-compute[71347]:         <nova:user uuid="cdfcb787b0f545f8b19e947d54d07b9c">tempest-ServerRescueNegativeTestJSON-1435712120-project-member</nova:user>
Apr 14 14:17:09 user nova-compute[71347]:         <nova:project uuid="b53efd997e3e47d898264dae8a27a5ad">tempest-ServerRescueNegativeTestJSON-1435712120</nova:project>
Apr 14 14:17:09 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:09 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:09 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:09 user nova-compute[71347]:         <nova:port uuid="9c5ceb2e-307c-4e1c-9356-b14b40e04290">
Apr 14 14:17:09 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 14:17:09 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:09 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:09 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:09 user nova-compute[71347]:   </metadata>
Apr 14 14:17:09 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:09 user nova-compute[71347]:     <system>
Apr 14 14:17:09 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:09 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:09 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:09 user nova-compute[71347]:       <entry name="serial">7c7956b5-905e-4a1a-b657-fe3aa5018258</entry>
Apr 14 14:17:09 user nova-compute[71347]:       <entry name="uuid">7c7956b5-905e-4a1a-b657-fe3aa5018258</entry>
Apr 14 14:17:09 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:09 user nova-compute[71347]:     </system>
Apr 14 14:17:09 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:09 user nova-compute[71347]:   <os>
Apr 14 14:17:09 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:09 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:09 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:09 user nova-compute[71347]:   </os>
Apr 14 14:17:09 user nova-compute[71347]:   <features>
Apr 14 14:17:09 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:09 user nova-compute[71347]:     <apic/>
Apr 14 14:17:09 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:09 user nova-compute[71347]:   </features>
Apr 14 14:17:09 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:09 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:09 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:09 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:09 user nova-compute[71347]:   </clock>
Apr 14 14:17:09 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:09 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:09 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:09 user nova-compute[71347]:   </cpu>
Apr 14 14:17:09 user nova-compute[71347]:   <devices>
Apr 14 14:17:09 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:09 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:09 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk"/>
Apr 14 14:17:09 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:09 user nova-compute[71347]:     </disk>
Apr 14 14:17:09 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:09 user nova-compute[71347]:       <mac address="fa:16:3e:df:88:c6"/>
Apr 14 14:17:09 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:09 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:09 user nova-compute[71347]:       <target dev="tap9c5ceb2e-30"/>
Apr 14 14:17:09 user nova-compute[71347]:     </interface>
Apr 14 14:17:09 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:09 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/console.log" append="off"/>
Apr 14 14:17:09 user nova-compute[71347]:     </serial>
Apr 14 14:17:09 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:09 user nova-compute[71347]:     <video>
Apr 14 14:17:09 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:09 user nova-compute[71347]:     </video>
Apr 14 14:17:09 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:09 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:09 user nova-compute[71347]:     </rng>
Apr 14 14:17:09 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:09 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:09 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:09 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:09 user nova-compute[71347]:   </devices>
Apr 14 14:17:09 user nova-compute[71347]: </domain>
Apr 14 14:17:09 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1496827',display_name='tempest-ServerRescueNegativeTestJSON-server-1496827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1496827',id=2,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-kgeq8ou2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:02Z,user_data=None,user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=7c7956b5-905e-4a1a-b657-fe3aa5018258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:88:c6,bridge_name='br-int',has_traffic_filtering=True,id=9c5ceb2e-307c-4e1c-9356-b14b40e04290,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ceb2e-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG os_vif [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:88:c6,bridge_name='br-int',has_traffic_filtering=True,id=9c5ceb2e-307c-4e1c-9356-b14b40e04290,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ceb2e-30') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.192s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.policy [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Created schema index Interface.name {{(pid=71347) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Created schema index Port.name {{(pid=71347) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Created schema index Bridge.name {{(pid=71347) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [POLLOUT] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:09 user nova-compute[71347]: INFO oslo.privsep.daemon [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmply4fpkb8/privsep.sock']
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk 1073741824" returned: 0 in 0.042s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:09 user sudo[80145]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmply4fpkb8/privsep.sock
Apr 14 14:17:09 user sudo[80145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Cannot resize image /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.objects.instance [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lazy-loading 'migration_context' on Instance uuid 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Ensure instance console log exists: /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Successfully updated port: 1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquired lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:09 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-changed-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Refreshing instance network info cache due to event network-changed-1a957ddb-f21a-4f08-8309-8c866fd2d6c4. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Acquiring lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:10 user nova-compute[71347]: DEBUG nova.network.neutron [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updated VIF entry in instance network info cache for port 9c5ceb2e-307c-4e1c-9356-b14b40e04290. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:10 user nova-compute[71347]: DEBUG nova.network.neutron [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updating instance_info_cache with network_info: [{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e99862c4-a480-48b2-857f-02973f58d0e4 req-a5d03df6-f0b9-40f5-bd19-bf7eb11090f2 service nova] Releasing lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:10 user sudo[80145]: pam_unix(sudo:session): session closed for user root
Apr 14 14:17:10 user nova-compute[71347]: INFO oslo.privsep.daemon [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Spawned new privsep daemon via rootwrap
Apr 14 14:17:10 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 14:17:10 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 14:17:10 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 14:17:10 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80154
Apr 14 14:17:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c5ceb2e-30, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c5ceb2e-30, col_values=(('external_ids', {'iface-id': '9c5ceb2e-307c-4e1c-9356-b14b40e04290', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:88:c6', 'vm-uuid': '7c7956b5-905e-4a1a-b657-fe3aa5018258'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:11 user nova-compute[71347]: INFO os_vif [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:88:c6,bridge_name='br-int',has_traffic_filtering=True,id=9c5ceb2e-307c-4e1c-9356-b14b40e04290,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ceb2e-30')
Apr 14 14:17:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No VIF found with MAC fa:16:3e:df:88:c6, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updating instance_info_cache with network_info: [{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Releasing lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance network_info: |[{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Acquired lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.network.neutron [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Refreshing network info cache for port 1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Start _get_guest_xml network_info=[{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:12 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:12 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-667599017',display_name='tempest-ServerRescueNegativeTestJSON-server-667599017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-667599017',id=1,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-jq8kt60n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:00Z,user_data=None,user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=30643f90-4347-4b1e-b1ca-57e69e716fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:22:e9,bridge_name='br-int',has_traffic_filtering=True,id=1a957ddb-f21a-4f08-8309-8c866fd2d6c4,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a957ddb-f2') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'pci_devices' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:12 user nova-compute[71347]:   <uuid>30643f90-4347-4b1e-b1ca-57e69e716fb4</uuid>
Apr 14 14:17:12 user nova-compute[71347]:   <name>instance-00000001</name>
Apr 14 14:17:12 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:12 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:12 user nova-compute[71347]:   <metadata>
Apr 14 14:17:12 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:12 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:12 user nova-compute[71347]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-667599017</nova:name>
Apr 14 14:17:12 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:12</nova:creationTime>
Apr 14 14:17:12 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:12 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:12 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:12 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:12 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:12 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:12 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:12 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:12 user nova-compute[71347]:         <nova:user uuid="cdfcb787b0f545f8b19e947d54d07b9c">tempest-ServerRescueNegativeTestJSON-1435712120-project-member</nova:user>
Apr 14 14:17:12 user nova-compute[71347]:         <nova:project uuid="b53efd997e3e47d898264dae8a27a5ad">tempest-ServerRescueNegativeTestJSON-1435712120</nova:project>
Apr 14 14:17:12 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:12 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:12 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:12 user nova-compute[71347]:         <nova:port uuid="1a957ddb-f21a-4f08-8309-8c866fd2d6c4">
Apr 14 14:17:12 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 14:17:12 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:12 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:12 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:12 user nova-compute[71347]:   </metadata>
Apr 14 14:17:12 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:12 user nova-compute[71347]:     <system>
Apr 14 14:17:12 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:12 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:12 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:12 user nova-compute[71347]:       <entry name="serial">30643f90-4347-4b1e-b1ca-57e69e716fb4</entry>
Apr 14 14:17:12 user nova-compute[71347]:       <entry name="uuid">30643f90-4347-4b1e-b1ca-57e69e716fb4</entry>
Apr 14 14:17:12 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:12 user nova-compute[71347]:     </system>
Apr 14 14:17:12 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:12 user nova-compute[71347]:   <os>
Apr 14 14:17:12 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:12 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:12 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:12 user nova-compute[71347]:   </os>
Apr 14 14:17:12 user nova-compute[71347]:   <features>
Apr 14 14:17:12 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:12 user nova-compute[71347]:     <apic/>
Apr 14 14:17:12 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:12 user nova-compute[71347]:   </features>
Apr 14 14:17:12 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:12 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:12 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:12 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:12 user nova-compute[71347]:   </clock>
Apr 14 14:17:12 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:12 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:12 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:12 user nova-compute[71347]:   </cpu>
Apr 14 14:17:12 user nova-compute[71347]:   <devices>
Apr 14 14:17:12 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:12 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:12 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk"/>
Apr 14 14:17:12 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:12 user nova-compute[71347]:     </disk>
Apr 14 14:17:12 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:12 user nova-compute[71347]:       <mac address="fa:16:3e:ad:22:e9"/>
Apr 14 14:17:12 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:12 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:12 user nova-compute[71347]:       <target dev="tap1a957ddb-f2"/>
Apr 14 14:17:12 user nova-compute[71347]:     </interface>
Apr 14 14:17:12 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:12 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/console.log" append="off"/>
Apr 14 14:17:12 user nova-compute[71347]:     </serial>
Apr 14 14:17:12 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:12 user nova-compute[71347]:     <video>
Apr 14 14:17:12 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:12 user nova-compute[71347]:     </video>
Apr 14 14:17:12 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:12 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:12 user nova-compute[71347]:     </rng>
Apr 14 14:17:12 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:12 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:12 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:12 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:12 user nova-compute[71347]:   </devices>
Apr 14 14:17:12 user nova-compute[71347]: </domain>
Apr 14 14:17:12 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-667599017',display_name='tempest-ServerRescueNegativeTestJSON-server-667599017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-667599017',id=1,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-jq8kt60n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:00Z,user_data=None,user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=30643f90-4347-4b1e-b1ca-57e69e716fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:22:e9,bridge_name='br-int',has_traffic_filtering=True,id=1a957ddb-f21a-4f08-8309-8c866fd2d6c4,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a957ddb-f2') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG os_vif [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:22:e9,bridge_name='br-int',has_traffic_filtering=True,id=1a957ddb-f21a-4f08-8309-8c866fd2d6c4,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a957ddb-f2') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a957ddb-f2, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a957ddb-f2, col_values=(('external_ids', {'iface-id': '1a957ddb-f21a-4f08-8309-8c866fd2d6c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:22:e9', 'vm-uuid': '30643f90-4347-4b1e-b1ca-57e69e716fb4'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:12 user nova-compute[71347]: INFO os_vif [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:22:e9,bridge_name='br-int',has_traffic_filtering=True,id=1a957ddb-f21a-4f08-8309-8c866fd2d6c4,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a957ddb-f2')
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Successfully created port: af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No VIF found with MAC fa:16:3e:ad:22:e9, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:12 user nova-compute[71347]: INFO nova.compute.claims [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Claim successful on node user
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Creating image(s)
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Successfully updated port: 03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "refresh_cache-6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquired lock "refresh_cache-6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.158s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received event network-changed-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Refreshing instance network info cache due to event network-changed-03114745-3adc-4f7e-b3e5-6623abee6e40. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Acquiring lock "refresh_cache-6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk 1073741824" returned: 0 in 0.084s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.policy [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.neutron [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updated VIF entry in instance network info cache for port 1a957ddb-f21a-4f08-8309-8c866fd2d6c4. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.neutron [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updating instance_info_cache with network_info: [{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-85cdf9a9-3e60-4d4f-afae-e2b6393af731 req-e54ab429-6c4b-423c-95a2-951d29b1d270 service nova] Releasing lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Cannot resize image /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.objects.instance [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'migration_context' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Ensure instance console log exists: /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Updating instance_info_cache with network_info: [{"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Releasing lock "refresh_cache-6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Instance network_info: |[{"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Acquired lock "refresh_cache-6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.neutron [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Refreshing network info cache for port 03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Start _get_guest_xml network_info=[{"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:13 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:13 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1210991027',display_name='tempest-VolumesActionsTest-instance-1210991027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1210991027',id=3,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e71e69f67a4c44be53fa655a7b50e5',ramdisk_id='',reservation_id='r-e9m60xri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1835732015',owner_user_name='tempest-VolumesActionsTest-1835732015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:04Z,user_data=None,user_id='f6a767acbdff4f65bef46f45d0c745f7',uuid=6ff5dcc6-7fcf-4785-88dd-f3104832a2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Converting VIF {"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=03114745-3adc-4f7e-b3e5-6623abee6e40,network=Network(47bbc824-8196-42ee-a900-6160879c338b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03114745-3a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.objects.instance [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:13 user nova-compute[71347]:   <uuid>6ff5dcc6-7fcf-4785-88dd-f3104832a2b4</uuid>
Apr 14 14:17:13 user nova-compute[71347]:   <name>instance-00000003</name>
Apr 14 14:17:13 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:13 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:13 user nova-compute[71347]:   <metadata>
Apr 14 14:17:13 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:13 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:13 user nova-compute[71347]:       <nova:name>tempest-VolumesActionsTest-instance-1210991027</nova:name>
Apr 14 14:17:13 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:13</nova:creationTime>
Apr 14 14:17:13 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:13 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:13 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:13 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:13 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:13 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:13 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:13 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:13 user nova-compute[71347]:         <nova:user uuid="f6a767acbdff4f65bef46f45d0c745f7">tempest-VolumesActionsTest-1835732015-project-member</nova:user>
Apr 14 14:17:13 user nova-compute[71347]:         <nova:project uuid="b3e71e69f67a4c44be53fa655a7b50e5">tempest-VolumesActionsTest-1835732015</nova:project>
Apr 14 14:17:13 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:13 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:13 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:13 user nova-compute[71347]:         <nova:port uuid="03114745-3adc-4f7e-b3e5-6623abee6e40">
Apr 14 14:17:13 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 14:17:13 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:13 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:13 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:13 user nova-compute[71347]:   </metadata>
Apr 14 14:17:13 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:13 user nova-compute[71347]:     <system>
Apr 14 14:17:13 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:13 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:13 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:13 user nova-compute[71347]:       <entry name="serial">6ff5dcc6-7fcf-4785-88dd-f3104832a2b4</entry>
Apr 14 14:17:13 user nova-compute[71347]:       <entry name="uuid">6ff5dcc6-7fcf-4785-88dd-f3104832a2b4</entry>
Apr 14 14:17:13 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:13 user nova-compute[71347]:     </system>
Apr 14 14:17:13 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:13 user nova-compute[71347]:   <os>
Apr 14 14:17:13 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:13 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:13 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:13 user nova-compute[71347]:   </os>
Apr 14 14:17:13 user nova-compute[71347]:   <features>
Apr 14 14:17:13 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:13 user nova-compute[71347]:     <apic/>
Apr 14 14:17:13 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:13 user nova-compute[71347]:   </features>
Apr 14 14:17:13 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:13 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:13 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:13 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:13 user nova-compute[71347]:   </clock>
Apr 14 14:17:13 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:13 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:13 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:13 user nova-compute[71347]:   </cpu>
Apr 14 14:17:13 user nova-compute[71347]:   <devices>
Apr 14 14:17:13 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:13 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:13 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk"/>
Apr 14 14:17:13 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:13 user nova-compute[71347]:     </disk>
Apr 14 14:17:13 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:13 user nova-compute[71347]:       <mac address="fa:16:3e:c0:2b:05"/>
Apr 14 14:17:13 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:13 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:13 user nova-compute[71347]:       <target dev="tap03114745-3a"/>
Apr 14 14:17:13 user nova-compute[71347]:     </interface>
Apr 14 14:17:13 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:13 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/console.log" append="off"/>
Apr 14 14:17:13 user nova-compute[71347]:     </serial>
Apr 14 14:17:13 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:13 user nova-compute[71347]:     <video>
Apr 14 14:17:13 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:13 user nova-compute[71347]:     </video>
Apr 14 14:17:13 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:13 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:13 user nova-compute[71347]:     </rng>
Apr 14 14:17:13 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:13 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:13 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:13 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:13 user nova-compute[71347]:   </devices>
Apr 14 14:17:13 user nova-compute[71347]: </domain>
Apr 14 14:17:13 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1210991027',display_name='tempest-VolumesActionsTest-instance-1210991027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1210991027',id=3,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e71e69f67a4c44be53fa655a7b50e5',ramdisk_id='',reservation_id='r-e9m60xri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1835732015',owner_user_name='tempest-VolumesActionsTest-1835732015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:04Z,user_data=None,user_id='f6a767acbdff4f65bef46f45d0c745f7',uuid=6ff5dcc6-7fcf-4785-88dd-f3104832a2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Converting VIF {"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=03114745-3adc-4f7e-b3e5-6623abee6e40,network=Network(47bbc824-8196-42ee-a900-6160879c338b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03114745-3a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG os_vif [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=03114745-3adc-4f7e-b3e5-6623abee6e40,network=Network(47bbc824-8196-42ee-a900-6160879c338b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03114745-3a') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03114745-3a, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03114745-3a, col_values=(('external_ids', {'iface-id': '03114745-3adc-4f7e-b3e5-6623abee6e40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:2b:05', 'vm-uuid': '6ff5dcc6-7fcf-4785-88dd-f3104832a2b4'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:13 user nova-compute[71347]: INFO os_vif [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=03114745-3adc-4f7e-b3e5-6623abee6e40,network=Network(47bbc824-8196-42ee-a900-6160879c338b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03114745-3a')
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] No VIF found with MAC fa:16:3e:c0:2b:05, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] No waiting events found dispatching network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:14 user nova-compute[71347]: WARNING nova.compute.manager [req-5860205f-45d1-43c8-b9bb-8ce3445fa8d7 req-29ef60b2-8d2d-414a-a544-7a8319007643 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received unexpected event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance with vm_state building and task_state spawning.
Apr 14 14:17:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Updated VIF entry in instance network info cache for port 03114745-3adc-4f7e-b3e5-6623abee6e40. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Updating instance_info_cache with network_info: [{"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2fa76ce8-ab25-4680-a5b9-9526ed23282f req-1f908aca-e89a-41c4-894d-3581dedd7d0b service nova] Releasing lock "refresh_cache-6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Successfully updated port: af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquired lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Updating instance_info_cache with network_info: [{"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Releasing lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Instance network_info: |[{"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Start _get_guest_xml network_info=[{"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:15 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:15 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2047783908',display_name='tempest-ServersNegativeTestJSON-server-2047783908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2047783908',id=4,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08dbbd3691924823b98d44b11508019e',ramdisk_id='',reservation_id='r-nn1l7cxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1373448962',owner_user_name='tempest-ServersNegativeTestJSON-1373448962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:09Z,user_data=None,user_id='a609ae82102a4ec994823e59f1a37378',uuid=0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converting VIF {"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e8:ba,bridge_name='br-int',has_traffic_filtering=True,id=af22d0f9-f6de-4604-90f0-833f831a7a37,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf22d0f9-f6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.objects.instance [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:15 user nova-compute[71347]:   <uuid>0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8</uuid>
Apr 14 14:17:15 user nova-compute[71347]:   <name>instance-00000004</name>
Apr 14 14:17:15 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:15 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:15 user nova-compute[71347]:   <metadata>
Apr 14 14:17:15 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:15 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:15 user nova-compute[71347]:       <nova:name>tempest-ServersNegativeTestJSON-server-2047783908</nova:name>
Apr 14 14:17:15 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:15</nova:creationTime>
Apr 14 14:17:15 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:15 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:15 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:15 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:15 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:15 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:15 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:15 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:15 user nova-compute[71347]:         <nova:user uuid="a609ae82102a4ec994823e59f1a37378">tempest-ServersNegativeTestJSON-1373448962-project-member</nova:user>
Apr 14 14:17:15 user nova-compute[71347]:         <nova:project uuid="08dbbd3691924823b98d44b11508019e">tempest-ServersNegativeTestJSON-1373448962</nova:project>
Apr 14 14:17:15 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:15 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:15 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:15 user nova-compute[71347]:         <nova:port uuid="af22d0f9-f6de-4604-90f0-833f831a7a37">
Apr 14 14:17:15 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 14:17:15 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:15 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:15 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:15 user nova-compute[71347]:   </metadata>
Apr 14 14:17:15 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:15 user nova-compute[71347]:     <system>
Apr 14 14:17:15 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:15 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:15 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:15 user nova-compute[71347]:       <entry name="serial">0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8</entry>
Apr 14 14:17:15 user nova-compute[71347]:       <entry name="uuid">0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8</entry>
Apr 14 14:17:15 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:15 user nova-compute[71347]:     </system>
Apr 14 14:17:15 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:15 user nova-compute[71347]:   <os>
Apr 14 14:17:15 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:15 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:15 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:15 user nova-compute[71347]:   </os>
Apr 14 14:17:15 user nova-compute[71347]:   <features>
Apr 14 14:17:15 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:15 user nova-compute[71347]:     <apic/>
Apr 14 14:17:15 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:15 user nova-compute[71347]:   </features>
Apr 14 14:17:15 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:15 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:15 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:15 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:15 user nova-compute[71347]:   </clock>
Apr 14 14:17:15 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:15 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:15 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:15 user nova-compute[71347]:   </cpu>
Apr 14 14:17:15 user nova-compute[71347]:   <devices>
Apr 14 14:17:15 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:15 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:15 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk"/>
Apr 14 14:17:15 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:15 user nova-compute[71347]:     </disk>
Apr 14 14:17:15 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:15 user nova-compute[71347]:       <mac address="fa:16:3e:b8:e8:ba"/>
Apr 14 14:17:15 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:15 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:15 user nova-compute[71347]:       <target dev="tapaf22d0f9-f6"/>
Apr 14 14:17:15 user nova-compute[71347]:     </interface>
Apr 14 14:17:15 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:15 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/console.log" append="off"/>
Apr 14 14:17:15 user nova-compute[71347]:     </serial>
Apr 14 14:17:15 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:15 user nova-compute[71347]:     <video>
Apr 14 14:17:15 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:15 user nova-compute[71347]:     </video>
Apr 14 14:17:15 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:15 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:15 user nova-compute[71347]:     </rng>
Apr 14 14:17:15 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:15 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:15 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:15 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:15 user nova-compute[71347]:   </devices>
Apr 14 14:17:15 user nova-compute[71347]: </domain>
Apr 14 14:17:15 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2047783908',display_name='tempest-ServersNegativeTestJSON-server-2047783908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2047783908',id=4,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08dbbd3691924823b98d44b11508019e',ramdisk_id='',reservation_id='r-nn1l7cxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1373448962',owner_user_name='tempest-ServersNegativeTestJSON-1373448962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:09Z,user_data=None,user_id='a609ae82102a4ec994823e59f1a37378',uuid=0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converting VIF {"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e8:ba,bridge_name='br-int',has_traffic_filtering=True,id=af22d0f9-f6de-4604-90f0-833f831a7a37,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf22d0f9-f6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG os_vif [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e8:ba,bridge_name='br-int',has_traffic_filtering=True,id=af22d0f9-f6de-4604-90f0-833f831a7a37,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf22d0f9-f6') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf22d0f9-f6, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf22d0f9-f6, col_values=(('external_ids', {'iface-id': 'af22d0f9-f6de-4604-90f0-833f831a7a37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:e8:ba', 'vm-uuid': '0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:15 user nova-compute[71347]: INFO os_vif [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e8:ba,bridge_name='br-int',has_traffic_filtering=True,id=af22d0f9-f6de-4604-90f0-833f831a7a37,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf22d0f9-f6')
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] No VIF found with MAC fa:16:3e:b8:e8:ba, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] No waiting events found dispatching network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:16 user nova-compute[71347]: WARNING nova.compute.manager [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received unexpected event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance with vm_state building and task_state spawning.
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received event network-changed-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Refreshing instance network info cache due to event network-changed-af22d0f9-f6de-4604-90f0-833f831a7a37. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Acquiring lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Acquired lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.network.neutron [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Refreshing network info cache for port af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.compute.claims [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Claim successful on node user
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481836.4454038, 7c7956b5-905e-4a1a-b657-fe3aa5018258 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] VM Resumed (Lifecycle Event)
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Instance spawned successfully.
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481836.45261, 7c7956b5-905e-4a1a-b657-fe3aa5018258 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] VM Started (Lifecycle Event)
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Took 14.21 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.compute.manager [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Took 14.95 seconds to build instance.
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5de1437b-20d5-46f3-bef3-279d9de9d4a4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.105s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:16 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:16 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:17 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Creating image(s)
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "/opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "/opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "/opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.compute.manager [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.compute.manager [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:17 user nova-compute[71347]: WARNING nova.compute.manager [req-bdbc7098-bfe4-4a53-87f5-7c794d25b141 req-38905567-100c-461d-b5c6-345b01eb0f2b service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state building and task_state spawning.
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.196s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.policy [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43e27123c26e416a8d024d4029249f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec387d0522a482998dc856bf579d1af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.network.neutron [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Updated VIF entry in instance network info cache for port af22d0f9-f6de-4604-90f0-833f831a7a37. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.network.neutron [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Updating instance_info_cache with network_info: [{"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk 1073741824" returned: 0 in 0.061s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-296e7256-b44d-4fc3-8040-6e5206e494fa req-b61d9f5f-1f06-478d-9521-120db4719b21 service nova] Releasing lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.174s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Cannot resize image /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lazy-loading 'migration_context' on Instance uuid 06baebb6-4922-4d82-b396-48bf76c60f2d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Ensure instance console log exists: /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:18 user nova-compute[71347]: DEBUG nova.network.neutron [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Successfully created port: 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481839.5757868, 30643f90-4347-4b1e-b1ca-57e69e716fb4 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] VM Resumed (Lifecycle Event)
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance spawned successfully.
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481839.5764484, 30643f90-4347-4b1e-b1ca-57e69e716fb4 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] VM Started (Lifecycle Event)
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:19 user nova-compute[71347]: WARNING nova.compute.manager [req-df32c589-b1bf-4f2b-a7c7-823d133a5e38 req-7a35cea2-d330-4a8b-96cd-7340aab0d0fb service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state building and task_state spawning.
Apr 14 14:17:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:19 user nova-compute[71347]: INFO nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Took 19.68 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:19 user nova-compute[71347]: INFO nova.compute.manager [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Took 20.58 seconds to build instance.
Apr 14 14:17:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f0711f38-485e-4eaa-86ff-b839058b0b43 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.792s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481840.1050136, 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] VM Resumed (Lifecycle Event)
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Instance spawned successfully.
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481840.107015, 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] VM Started (Lifecycle Event)
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Took 16.37 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Took 17.06 seconds to build instance.
Apr 14 14:17:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ea9f849-89b7-4f5d-a740-f1ad40b6c737 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.231s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481840.7427254, 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] VM Resumed (Lifecycle Event)
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Instance spawned successfully.
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481840.7476933, 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] VM Started (Lifecycle Event)
Apr 14 14:17:20 user nova-compute[71347]: INFO nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Took 12.07 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:21 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:21 user nova-compute[71347]: INFO nova.compute.manager [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Took 12.76 seconds to build instance.
Apr 14 14:17:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-859d987a-1224-48ff-8d98-97adad76138b tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.895s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Successfully created port: 1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received event network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Acquiring lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] No waiting events found dispatching network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:21 user nova-compute[71347]: WARNING nova.compute.manager [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received unexpected event network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 for instance with vm_state active and task_state None.
Apr 14 14:17:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received event network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Acquiring lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] No waiting events found dispatching network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:21 user nova-compute[71347]: WARNING nova.compute.manager [req-3df67e20-b62f-436f-93c7-ebf67555bc8f req-621e0efc-2484-40e4-af08-6d2af583b4cb service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received unexpected event network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 for instance with vm_state active and task_state None.
Apr 14 14:17:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Successfully updated port: 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.network.neutron [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance network_info: |[{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Start _get_guest_xml network_info=[{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:23 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:23 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-178100452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.objects.instance [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_devices' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:23 user nova-compute[71347]:   <uuid>a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</uuid>
Apr 14 14:17:23 user nova-compute[71347]:   <name>instance-00000005</name>
Apr 14 14:17:23 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:23 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:23 user nova-compute[71347]:   <metadata>
Apr 14 14:17:23 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:23 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:23 user nova-compute[71347]:       <nova:name>tempest-ServerActionsTestJSON-server-178100452</nova:name>
Apr 14 14:17:23 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:23</nova:creationTime>
Apr 14 14:17:23 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:23 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:23 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:23 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:23 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:23 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:23 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:23 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:23 user nova-compute[71347]:         <nova:user uuid="797d2d1bff8e4b26afe7856e4c3877cf">tempest-ServerActionsTestJSON-932644409-project-member</nova:user>
Apr 14 14:17:23 user nova-compute[71347]:         <nova:project uuid="3b087f26a80045f3844873220a67a4e4">tempest-ServerActionsTestJSON-932644409</nova:project>
Apr 14 14:17:23 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:23 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:23 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:23 user nova-compute[71347]:         <nova:port uuid="2eb1d71a-d0d7-473d-9eef-b939fd4b55ef">
Apr 14 14:17:23 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:17:23 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:23 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:23 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:23 user nova-compute[71347]:   </metadata>
Apr 14 14:17:23 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:23 user nova-compute[71347]:     <system>
Apr 14 14:17:23 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:23 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:23 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:23 user nova-compute[71347]:       <entry name="serial">a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</entry>
Apr 14 14:17:23 user nova-compute[71347]:       <entry name="uuid">a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</entry>
Apr 14 14:17:23 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:23 user nova-compute[71347]:     </system>
Apr 14 14:17:23 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:23 user nova-compute[71347]:   <os>
Apr 14 14:17:23 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:23 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:23 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:23 user nova-compute[71347]:   </os>
Apr 14 14:17:23 user nova-compute[71347]:   <features>
Apr 14 14:17:23 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:23 user nova-compute[71347]:     <apic/>
Apr 14 14:17:23 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:23 user nova-compute[71347]:   </features>
Apr 14 14:17:23 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:23 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:23 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:23 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:23 user nova-compute[71347]:   </clock>
Apr 14 14:17:23 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:23 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:23 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:23 user nova-compute[71347]:   </cpu>
Apr 14 14:17:23 user nova-compute[71347]:   <devices>
Apr 14 14:17:23 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:23 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:23 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk"/>
Apr 14 14:17:23 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:23 user nova-compute[71347]:     </disk>
Apr 14 14:17:23 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:23 user nova-compute[71347]:       <mac address="fa:16:3e:32:d4:b0"/>
Apr 14 14:17:23 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:23 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:23 user nova-compute[71347]:       <target dev="tap2eb1d71a-d0"/>
Apr 14 14:17:23 user nova-compute[71347]:     </interface>
Apr 14 14:17:23 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:23 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/console.log" append="off"/>
Apr 14 14:17:23 user nova-compute[71347]:     </serial>
Apr 14 14:17:23 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:23 user nova-compute[71347]:     <video>
Apr 14 14:17:23 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:23 user nova-compute[71347]:     </video>
Apr 14 14:17:23 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:23 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:23 user nova-compute[71347]:     </rng>
Apr 14 14:17:23 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:23 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:23 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:23 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:23 user nova-compute[71347]:   </devices>
Apr 14 14:17:23 user nova-compute[71347]: </domain>
Apr 14 14:17:23 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-178100452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG os_vif [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eb1d71a-d0, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eb1d71a-d0, col_values=(('external_ids', {'iface-id': '2eb1d71a-d0d7-473d-9eef-b939fd4b55ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:d4:b0', 'vm-uuid': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:23 user nova-compute[71347]: INFO os_vif [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0')
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No VIF found with MAC fa:16:3e:32:d4:b0, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:23 user nova-compute[71347]: INFO nova.compute.claims [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Claim successful on node user
Apr 14 14:17:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-changed-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Refreshing instance network info cache due to event network-changed-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.network.neutron [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Refreshing network info cache for port 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.983s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.network.neutron [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:24 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:24 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:25 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Creating image(s)
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.policy [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.335s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.219s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.network.neutron [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updated VIF entry in instance network info cache for port 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.network.neutron [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received event network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Acquiring lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] No waiting events found dispatching network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:25 user nova-compute[71347]: WARNING nova.compute.manager [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received unexpected event network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 for instance with vm_state active and task_state None.
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received event network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Acquiring lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] No waiting events found dispatching network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:25 user nova-compute[71347]: WARNING nova.compute.manager [req-c2fac9f4-b7d9-4f2b-86af-7a20bcbe17dd req-ba27f3ab-e3bc-403c-998f-c0fa53221f95 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received unexpected event network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 for instance with vm_state active and task_state None.
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk 1073741824" returned: 0 in 0.093s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Successfully updated port: 1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "refresh_cache-06baebb6-4922-4d82-b396-48bf76c60f2d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquired lock "refresh_cache-06baebb6-4922-4d82-b396-48bf76c60f2d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:25 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.283s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received event network-changed-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Refreshing instance network info cache due to event network-changed-1ec51781-92ba-45d2-9635-5aa1c6cf918a. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] Acquiring lock "refresh_cache-06baebb6-4922-4d82-b396-48bf76c60f2d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Cannot resize image /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.objects.instance [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'migration_context' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Ensure instance console log exists: /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:26 user nova-compute[71347]: WARNING nova.compute.manager [req-8b08c3d9-56ae-4fea-b9ff-0bd5afee7a91 req-39e8015c-6f9a-49f9-8126-0ef51f17c822 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state building and task_state spawning.
Apr 14 14:17:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Successfully created port: 839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481848.1470184, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:28 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Resumed (Lifecycle Event)
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:28 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance spawned successfully.
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:28 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481848.153088, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:28 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Started (Lifecycle Event)
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:28 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:28 user nova-compute[71347]: INFO nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Took 15.63 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:28 user nova-compute[71347]: INFO nova.compute.manager [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Took 16.36 seconds to build instance.
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:28 user nova-compute[71347]: WARNING nova.compute.manager [req-ab1b3314-038c-43c2-b081-d797555115ee req-397d7529-3823-4302-a71c-e321805b526d service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state None.
Apr 14 14:17:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-366fe208-7690-4642-821e-d98790dd06a1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.479s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Updating instance_info_cache with network_info: [{"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Releasing lock "refresh_cache-06baebb6-4922-4d82-b396-48bf76c60f2d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Instance network_info: |[{"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] Acquired lock "refresh_cache-06baebb6-4922-4d82-b396-48bf76c60f2d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Refreshing network info cache for port 1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Start _get_guest_xml network_info=[{"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:28 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:28 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1709371088',display_name='tempest-DeleteServersTestJSON-server-1709371088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1709371088',id=6,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec387d0522a482998dc856bf579d1af',ramdisk_id='',reservation_id='r-fzzhwimx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2021198395',owner_user_name='tempest-DeleteServersTestJSON-2021198395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:17Z,user_data=None,user_id='43e27123c26e416a8d024d4029249f4b',uuid=06baebb6-4922-4d82-b396-48bf76c60f2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Converting VIF {"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:48,bridge_name='br-int',has_traffic_filtering=True,id=1ec51781-92ba-45d2-9635-5aa1c6cf918a,network=Network(10c13d5f-fce7-4ec7-a3a3-82927a3d1185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec51781-92') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lazy-loading 'pci_devices' on Instance uuid 06baebb6-4922-4d82-b396-48bf76c60f2d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:28 user nova-compute[71347]:   <uuid>06baebb6-4922-4d82-b396-48bf76c60f2d</uuid>
Apr 14 14:17:28 user nova-compute[71347]:   <name>instance-00000006</name>
Apr 14 14:17:28 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:28 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:28 user nova-compute[71347]:   <metadata>
Apr 14 14:17:28 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:28 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:28 user nova-compute[71347]:       <nova:name>tempest-DeleteServersTestJSON-server-1709371088</nova:name>
Apr 14 14:17:28 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:28</nova:creationTime>
Apr 14 14:17:28 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:28 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:28 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:28 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:28 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:28 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:28 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:28 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:28 user nova-compute[71347]:         <nova:user uuid="43e27123c26e416a8d024d4029249f4b">tempest-DeleteServersTestJSON-2021198395-project-member</nova:user>
Apr 14 14:17:28 user nova-compute[71347]:         <nova:project uuid="4ec387d0522a482998dc856bf579d1af">tempest-DeleteServersTestJSON-2021198395</nova:project>
Apr 14 14:17:28 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:28 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:28 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:28 user nova-compute[71347]:         <nova:port uuid="1ec51781-92ba-45d2-9635-5aa1c6cf918a">
Apr 14 14:17:28 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:17:28 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:28 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:28 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:28 user nova-compute[71347]:   </metadata>
Apr 14 14:17:28 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:28 user nova-compute[71347]:     <system>
Apr 14 14:17:28 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:28 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:28 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:28 user nova-compute[71347]:       <entry name="serial">06baebb6-4922-4d82-b396-48bf76c60f2d</entry>
Apr 14 14:17:28 user nova-compute[71347]:       <entry name="uuid">06baebb6-4922-4d82-b396-48bf76c60f2d</entry>
Apr 14 14:17:28 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:28 user nova-compute[71347]:     </system>
Apr 14 14:17:28 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:28 user nova-compute[71347]:   <os>
Apr 14 14:17:28 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:28 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:28 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:28 user nova-compute[71347]:   </os>
Apr 14 14:17:28 user nova-compute[71347]:   <features>
Apr 14 14:17:28 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:28 user nova-compute[71347]:     <apic/>
Apr 14 14:17:28 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:28 user nova-compute[71347]:   </features>
Apr 14 14:17:28 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:28 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:28 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:28 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:28 user nova-compute[71347]:   </clock>
Apr 14 14:17:28 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:28 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:28 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:28 user nova-compute[71347]:   </cpu>
Apr 14 14:17:28 user nova-compute[71347]:   <devices>
Apr 14 14:17:28 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:28 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:28 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk"/>
Apr 14 14:17:28 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:28 user nova-compute[71347]:     </disk>
Apr 14 14:17:28 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:28 user nova-compute[71347]:       <mac address="fa:16:3e:63:a6:48"/>
Apr 14 14:17:28 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:28 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:28 user nova-compute[71347]:       <target dev="tap1ec51781-92"/>
Apr 14 14:17:28 user nova-compute[71347]:     </interface>
Apr 14 14:17:28 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:28 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/console.log" append="off"/>
Apr 14 14:17:28 user nova-compute[71347]:     </serial>
Apr 14 14:17:28 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:28 user nova-compute[71347]:     <video>
Apr 14 14:17:28 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:28 user nova-compute[71347]:     </video>
Apr 14 14:17:28 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:28 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:28 user nova-compute[71347]:     </rng>
Apr 14 14:17:28 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:28 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:28 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:28 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:28 user nova-compute[71347]:   </devices>
Apr 14 14:17:28 user nova-compute[71347]: </domain>
Apr 14 14:17:28 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1709371088',display_name='tempest-DeleteServersTestJSON-server-1709371088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1709371088',id=6,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec387d0522a482998dc856bf579d1af',ramdisk_id='',reservation_id='r-fzzhwimx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2021198395',owner_user_name='tempest-DeleteServersTestJSON-2021198395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:17Z,user_data=None,user_id='43e27123c26e416a8d024d4029249f4b',uuid=06baebb6-4922-4d82-b396-48bf76c60f2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Converting VIF {"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:48,bridge_name='br-int',has_traffic_filtering=True,id=1ec51781-92ba-45d2-9635-5aa1c6cf918a,network=Network(10c13d5f-fce7-4ec7-a3a3-82927a3d1185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec51781-92') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG os_vif [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:48,bridge_name='br-int',has_traffic_filtering=True,id=1ec51781-92ba-45d2-9635-5aa1c6cf918a,network=Network(10c13d5f-fce7-4ec7-a3a3-82927a3d1185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec51781-92') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec51781-92, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec51781-92, col_values=(('external_ids', {'iface-id': '1ec51781-92ba-45d2-9635-5aa1c6cf918a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:a6:48', 'vm-uuid': '06baebb6-4922-4d82-b396-48bf76c60f2d'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:28 user nova-compute[71347]: INFO os_vif [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:48,bridge_name='br-int',has_traffic_filtering=True,id=1ec51781-92ba-45d2-9635-5aa1c6cf918a,network=Network(10c13d5f-fce7-4ec7-a3a3-82927a3d1185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec51781-92')
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] No VIF found with MAC fa:16:3e:63:a6:48, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG nova.network.neutron [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Successfully updated port: 839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG nova.network.neutron [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Updated VIF entry in instance network info cache for port 1ec51781-92ba-45d2-9635-5aa1c6cf918a. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG nova.network.neutron [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Updating instance_info_cache with network_info: [{"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquired lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG nova.network.neutron [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a4744310-7f88-4b9d-bcb0-596b6145f010 req-55ec77e7-fb90-4943-94a8-6b781d0950c0 service nova] Releasing lock "refresh_cache-06baebb6-4922-4d82-b396-48bf76c60f2d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-changed-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Refreshing instance network info cache due to event network-changed-839834af-8da2-4f1a-84c5-e0469c3679f5. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] Acquiring lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:30 user nova-compute[71347]: DEBUG nova.network.neutron [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.network.neutron [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Releasing lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance network_info: |[{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] Acquired lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.network.neutron [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Refreshing network info cache for port 839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Start _get_guest_xml network_info=[{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:32 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:32 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1743182580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1743182580',id=7,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtFgmxFsC73JI3EOJh01Vi6JhjHyCGpGBiOSuQtkbj5LzuB0w3biqviCjGuFN4y4RXRWYVOA71m7CX2sS0tv+XOQaF5SvRG09bebHIKCIKlHl28aGGTIvcDfXJMO71mjA==',key_name='tempest-keypair-394852903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-im4193la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=e81e92d6-b79e-46db-b69e-1f7584440287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.objects.instance [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'pci_devices' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:32 user nova-compute[71347]:   <uuid>e81e92d6-b79e-46db-b69e-1f7584440287</uuid>
Apr 14 14:17:32 user nova-compute[71347]:   <name>instance-00000007</name>
Apr 14 14:17:32 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:32 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:32 user nova-compute[71347]:   <metadata>
Apr 14 14:17:32 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:32 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:32 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1743182580</nova:name>
Apr 14 14:17:32 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:32</nova:creationTime>
Apr 14 14:17:32 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:32 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:32 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:32 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:32 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:32 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:32 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:32 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:32 user nova-compute[71347]:         <nova:user uuid="a7a99d9a44334bfeb39f6684853f6844">tempest-AttachVolumeShelveTestJSON-1666709251-project-member</nova:user>
Apr 14 14:17:32 user nova-compute[71347]:         <nova:project uuid="b8263321b4e34ea08350e97ac2a3a794">tempest-AttachVolumeShelveTestJSON-1666709251</nova:project>
Apr 14 14:17:32 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:32 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:32 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:32 user nova-compute[71347]:         <nova:port uuid="839834af-8da2-4f1a-84c5-e0469c3679f5">
Apr 14 14:17:32 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 14:17:32 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:32 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:32 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:32 user nova-compute[71347]:   </metadata>
Apr 14 14:17:32 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:32 user nova-compute[71347]:     <system>
Apr 14 14:17:32 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:32 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:32 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:32 user nova-compute[71347]:       <entry name="serial">e81e92d6-b79e-46db-b69e-1f7584440287</entry>
Apr 14 14:17:32 user nova-compute[71347]:       <entry name="uuid">e81e92d6-b79e-46db-b69e-1f7584440287</entry>
Apr 14 14:17:32 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:32 user nova-compute[71347]:     </system>
Apr 14 14:17:32 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:32 user nova-compute[71347]:   <os>
Apr 14 14:17:32 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:32 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:32 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:32 user nova-compute[71347]:   </os>
Apr 14 14:17:32 user nova-compute[71347]:   <features>
Apr 14 14:17:32 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:32 user nova-compute[71347]:     <apic/>
Apr 14 14:17:32 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:32 user nova-compute[71347]:   </features>
Apr 14 14:17:32 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:32 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:32 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:32 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:32 user nova-compute[71347]:   </clock>
Apr 14 14:17:32 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:32 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:32 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:32 user nova-compute[71347]:   </cpu>
Apr 14 14:17:32 user nova-compute[71347]:   <devices>
Apr 14 14:17:32 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:32 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:32 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk"/>
Apr 14 14:17:32 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:32 user nova-compute[71347]:     </disk>
Apr 14 14:17:32 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:32 user nova-compute[71347]:       <mac address="fa:16:3e:c9:08:26"/>
Apr 14 14:17:32 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:32 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:32 user nova-compute[71347]:       <target dev="tap839834af-8d"/>
Apr 14 14:17:32 user nova-compute[71347]:     </interface>
Apr 14 14:17:32 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:32 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/console.log" append="off"/>
Apr 14 14:17:32 user nova-compute[71347]:     </serial>
Apr 14 14:17:32 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:32 user nova-compute[71347]:     <video>
Apr 14 14:17:32 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:32 user nova-compute[71347]:     </video>
Apr 14 14:17:32 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:32 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:32 user nova-compute[71347]:     </rng>
Apr 14 14:17:32 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:32 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:32 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:32 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:32 user nova-compute[71347]:   </devices>
Apr 14 14:17:32 user nova-compute[71347]: </domain>
Apr 14 14:17:32 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1743182580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1743182580',id=7,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtFgmxFsC73JI3EOJh01Vi6JhjHyCGpGBiOSuQtkbj5LzuB0w3biqviCjGuFN4y4RXRWYVOA71m7CX2sS0tv+XOQaF5SvRG09bebHIKCIKlHl28aGGTIvcDfXJMO71mjA==',key_name='tempest-keypair-394852903',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-im4193la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=e81e92d6-b79e-46db-b69e-1f7584440287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG os_vif [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap839834af-8d, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap839834af-8d, col_values=(('external_ids', {'iface-id': '839834af-8da2-4f1a-84c5-e0469c3679f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:08:26', 'vm-uuid': 'e81e92d6-b79e-46db-b69e-1f7584440287'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:32 user nova-compute[71347]: INFO os_vif [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d')
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No VIF found with MAC fa:16:3e:c9:08:26, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481853.413068, 06baebb6-4922-4d82-b396-48bf76c60f2d => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:33 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] VM Resumed (Lifecycle Event)
Apr 14 14:17:33 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Instance spawned successfully.
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:33 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481853.4131944, 06baebb6-4922-4d82-b396-48bf76c60f2d => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:33 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] VM Started (Lifecycle Event)
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:33 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:33 user nova-compute[71347]: INFO nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Took 16.56 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received event network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] No waiting events found dispatching network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:33 user nova-compute[71347]: WARNING nova.compute.manager [req-5953aa22-cc8e-4189-8b08-2ed57579c37c req-6e3e039d-4edc-4fc7-9016-5c7757cdc8c8 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received unexpected event network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance with vm_state active and task_state None.
Apr 14 14:17:33 user nova-compute[71347]: INFO nova.compute.manager [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Took 17.63 seconds to build instance.
Apr 14 14:17:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4d1304a9-3497-4c74-9404-4b4fe8bc5eb9 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.791s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] No waiting events found dispatching network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:34 user nova-compute[71347]: WARNING nova.compute.manager [req-d4d3e0fb-a47b-4f1e-ab37-61557e44f3ef req-30f8050e-c215-42f8-90c6-ad3cdc6e06a2 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received unexpected event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 for instance with vm_state building and task_state spawning.
Apr 14 14:17:34 user nova-compute[71347]: DEBUG nova.network.neutron [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updated VIF entry in instance network info cache for port 839834af-8da2-4f1a-84c5-e0469c3679f5. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:34 user nova-compute[71347]: DEBUG nova.network.neutron [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bfe8484b-e6c7-4136-9e0b-196a4d92aed6 req-0857f138-de3d-4363-b941-4a2c87b8181b service nova] Releasing lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received event network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] No waiting events found dispatching network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:36 user nova-compute[71347]: WARNING nova.compute.manager [req-9d6168de-250b-4ad2-9c8a-2b9fe273478d req-d9c9ac3c-04f9-45f2-b3fd-ee66be1b5b4d service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received unexpected event network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance with vm_state active and task_state None.
Apr 14 14:17:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] No waiting events found dispatching network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:36 user nova-compute[71347]: WARNING nova.compute.manager [req-7a6a55ff-4c76-4cc3-83d0-46d229c78992 req-d92564a2-1e51-466f-8c7c-141998e1ea31 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received unexpected event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 for instance with vm_state building and task_state spawning.
Apr 14 14:17:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:37 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:37 user nova-compute[71347]: INFO nova.compute.claims [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Claim successful on node user
Apr 14 14:17:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481858.1549108, e81e92d6-b79e-46db-b69e-1f7584440287 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:38 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] VM Resumed (Lifecycle Event)
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance spawned successfully.
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:38 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481858.165043, e81e92d6-b79e-46db-b69e-1f7584440287 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:38 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] VM Started (Lifecycle Event)
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.981s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:38 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:38 user nova-compute[71347]: INFO nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Took 13.52 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:38 user nova-compute[71347]: INFO nova.compute.manager [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Took 15.33 seconds to build instance.
Apr 14 14:17:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08cfb826-5b23-4fa9-b2ce-13c9860d8e5e tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.607s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG nova.policy [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5c31630bdcb497da65f928490c26948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21be0383ba4cab992ec2b897e763f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Creating image(s)
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "/opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "/opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.226s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.297s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk 1073741824" returned: 0 in 0.089s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.163s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Cannot resize image /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG nova.objects.instance [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'migration_context' on Instance uuid bc70d475-20dd-4859-a6fe-d2d09341799e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Ensure instance console log exists: /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:40 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:40 user nova-compute[71347]: INFO nova.compute.claims [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Claim successful on node user
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Successfully created port: 513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.943s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.policy [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd54c4c3585e74670adcb025cf9331844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab9855c5aa444fb8c1636fda0b2f394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Creating image(s)
Apr 14 14:17:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "/opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "/opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.189s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.166s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk 1073741824" returned: 0 in 0.078s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.178s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Cannot resize image /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.objects.instance [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lazy-loading 'migration_context' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Ensure instance console log exists: /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.network.neutron [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Successfully created port: 53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Successfully updated port: 513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquired lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received event network-changed-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Refreshing instance network info cache due to event network-changed-513e9086-658d-44df-962e-3a4f16649083. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] Acquiring lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:42 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updating instance_info_cache with network_info: [{"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Releasing lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Instance network_info: |[{"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] Acquired lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.neutron [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Refreshing network info cache for port 513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Start _get_guest_xml network_info=[{"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:43 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:43 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556722134',display_name='tempest-VolumesAdminNegativeTest-server-1556722134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556722134',id=8,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQjfgmzxezY/KHcd5PdM3vkmvQnoAgqCZxGXXY6YTcu6O1yAZ/H9Mco+AeVrFCASW4ysVKsiv7y+LJXoAzQa4DW0tB/Tt/+WW7OwCivZK7OhQt19fhtQAO7wQJzSLFMQg==',key_name='tempest-keypair-706581506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa21be0383ba4cab992ec2b897e763f4',ramdisk_id='',reservation_id='r-jz0z2cjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1341751798',owner_user_name='tempest-VolumesAdminNegativeTest-1341751798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5c31630bdcb497da65f928490c26948',uuid=bc70d475-20dd-4859-a6fe-d2d09341799e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converting VIF {"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:41:4f,bridge_name='br-int',has_traffic_filtering=True,id=513e9086-658d-44df-962e-3a4f16649083,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513e9086-65') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.objects.instance [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'pci_devices' on Instance uuid bc70d475-20dd-4859-a6fe-d2d09341799e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:43 user nova-compute[71347]:   <uuid>bc70d475-20dd-4859-a6fe-d2d09341799e</uuid>
Apr 14 14:17:43 user nova-compute[71347]:   <name>instance-00000008</name>
Apr 14 14:17:43 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:43 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:43 user nova-compute[71347]:   <metadata>
Apr 14 14:17:43 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:43 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:43 user nova-compute[71347]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1556722134</nova:name>
Apr 14 14:17:43 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:43</nova:creationTime>
Apr 14 14:17:43 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:43 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:43 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:43 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:43 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:43 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:43 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:43 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:43 user nova-compute[71347]:         <nova:user uuid="e5c31630bdcb497da65f928490c26948">tempest-VolumesAdminNegativeTest-1341751798-project-member</nova:user>
Apr 14 14:17:43 user nova-compute[71347]:         <nova:project uuid="aa21be0383ba4cab992ec2b897e763f4">tempest-VolumesAdminNegativeTest-1341751798</nova:project>
Apr 14 14:17:43 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:43 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:43 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:43 user nova-compute[71347]:         <nova:port uuid="513e9086-658d-44df-962e-3a4f16649083">
Apr 14 14:17:43 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 14:17:43 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:43 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:43 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:43 user nova-compute[71347]:   </metadata>
Apr 14 14:17:43 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:43 user nova-compute[71347]:     <system>
Apr 14 14:17:43 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:43 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:43 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:43 user nova-compute[71347]:       <entry name="serial">bc70d475-20dd-4859-a6fe-d2d09341799e</entry>
Apr 14 14:17:43 user nova-compute[71347]:       <entry name="uuid">bc70d475-20dd-4859-a6fe-d2d09341799e</entry>
Apr 14 14:17:43 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:43 user nova-compute[71347]:     </system>
Apr 14 14:17:43 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:43 user nova-compute[71347]:   <os>
Apr 14 14:17:43 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:43 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:43 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:43 user nova-compute[71347]:   </os>
Apr 14 14:17:43 user nova-compute[71347]:   <features>
Apr 14 14:17:43 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:43 user nova-compute[71347]:     <apic/>
Apr 14 14:17:43 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:43 user nova-compute[71347]:   </features>
Apr 14 14:17:43 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:43 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:43 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:43 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:43 user nova-compute[71347]:   </clock>
Apr 14 14:17:43 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:43 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:43 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:43 user nova-compute[71347]:   </cpu>
Apr 14 14:17:43 user nova-compute[71347]:   <devices>
Apr 14 14:17:43 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:43 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:43 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk"/>
Apr 14 14:17:43 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:43 user nova-compute[71347]:     </disk>
Apr 14 14:17:43 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:43 user nova-compute[71347]:       <mac address="fa:16:3e:3e:41:4f"/>
Apr 14 14:17:43 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:43 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:43 user nova-compute[71347]:       <target dev="tap513e9086-65"/>
Apr 14 14:17:43 user nova-compute[71347]:     </interface>
Apr 14 14:17:43 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:43 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/console.log" append="off"/>
Apr 14 14:17:43 user nova-compute[71347]:     </serial>
Apr 14 14:17:43 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:43 user nova-compute[71347]:     <video>
Apr 14 14:17:43 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:43 user nova-compute[71347]:     </video>
Apr 14 14:17:43 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:43 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:43 user nova-compute[71347]:     </rng>
Apr 14 14:17:43 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:43 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:43 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:43 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:43 user nova-compute[71347]:   </devices>
Apr 14 14:17:43 user nova-compute[71347]: </domain>
Apr 14 14:17:43 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556722134',display_name='tempest-VolumesAdminNegativeTest-server-1556722134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556722134',id=8,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQjfgmzxezY/KHcd5PdM3vkmvQnoAgqCZxGXXY6YTcu6O1yAZ/H9Mco+AeVrFCASW4ysVKsiv7y+LJXoAzQa4DW0tB/Tt/+WW7OwCivZK7OhQt19fhtQAO7wQJzSLFMQg==',key_name='tempest-keypair-706581506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa21be0383ba4cab992ec2b897e763f4',ramdisk_id='',reservation_id='r-jz0z2cjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1341751798',owner_user_name='tempest-VolumesAdminNegativeTest-1341751798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5c31630bdcb497da65f928490c26948',uuid=bc70d475-20dd-4859-a6fe-d2d09341799e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converting VIF {"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:41:4f,bridge_name='br-int',has_traffic_filtering=True,id=513e9086-658d-44df-962e-3a4f16649083,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513e9086-65') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG os_vif [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:41:4f,bridge_name='br-int',has_traffic_filtering=True,id=513e9086-658d-44df-962e-3a4f16649083,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513e9086-65') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap513e9086-65, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap513e9086-65, col_values=(('external_ids', {'iface-id': '513e9086-658d-44df-962e-3a4f16649083', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:41:4f', 'vm-uuid': 'bc70d475-20dd-4859-a6fe-d2d09341799e'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:43 user nova-compute[71347]: INFO os_vif [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:41:4f,bridge_name='br-int',has_traffic_filtering=True,id=513e9086-658d-44df-962e-3a4f16649083,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513e9086-65')
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Successfully updated port: 53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquired lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received event network-changed-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Refreshing instance network info cache due to event network-changed-53a43ee4-c532-49fb-b441-84020cd63e8a. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] Acquiring lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] No VIF found with MAC fa:16:3e:3e:41:4f, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.network.neutron [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updated VIF entry in instance network info cache for port 513e9086-658d-44df-962e-3a4f16649083. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.network.neutron [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updating instance_info_cache with network_info: [{"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-29cf28a0-8c18-4895-89c6-07b6399579b1 req-4ca52b95-cc2c-4672-b07c-63a53144fe72 service nova] Releasing lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.network.neutron [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Updating instance_info_cache with network_info: [{"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Releasing lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Instance network_info: |[{"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] Acquired lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.network.neutron [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Refreshing network info cache for port 53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Start _get_guest_xml network_info=[{"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:44 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:44 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1181707762',display_name='tempest-TestVolumeSwap-server-1181707762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1181707762',id=9,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUHjZA/lLKTL8AYeb4MKZeMNC7337OmlBs6hgJc5vFrxuDLxwaaWgDr+nofdCoAuOjgQLOS5xfkD17Ozje4oKBUcPsZO+KEmoUYKmHrqoxiWCDi8m4XdobKcM0hp08pXg==',key_name='tempest-keypair-557766472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aab9855c5aa444fb8c1636fda0b2f394',ramdisk_id='',reservation_id='r-u57onffj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-306457705',owner_user_name='tempest-TestVolumeSwap-306457705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54c4c3585e74670adcb025cf9331844',uuid=4d417e09-6e54-4cad-91e5-7910ee4e784a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Converting VIF {"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:88:dd,bridge_name='br-int',has_traffic_filtering=True,id=53a43ee4-c532-49fb-b441-84020cd63e8a,network=Network(02d90be5-47ba-45f5-b49d-60de28b6639c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a43ee4-c5') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.objects.instance [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:44 user nova-compute[71347]:   <uuid>4d417e09-6e54-4cad-91e5-7910ee4e784a</uuid>
Apr 14 14:17:44 user nova-compute[71347]:   <name>instance-00000009</name>
Apr 14 14:17:44 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:44 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:44 user nova-compute[71347]:   <metadata>
Apr 14 14:17:44 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:44 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:44 user nova-compute[71347]:       <nova:name>tempest-TestVolumeSwap-server-1181707762</nova:name>
Apr 14 14:17:44 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:44</nova:creationTime>
Apr 14 14:17:44 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:44 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:44 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:44 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:44 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:44 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:44 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:44 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:44 user nova-compute[71347]:         <nova:user uuid="d54c4c3585e74670adcb025cf9331844">tempest-TestVolumeSwap-306457705-project-member</nova:user>
Apr 14 14:17:44 user nova-compute[71347]:         <nova:project uuid="aab9855c5aa444fb8c1636fda0b2f394">tempest-TestVolumeSwap-306457705</nova:project>
Apr 14 14:17:44 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:44 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:44 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:44 user nova-compute[71347]:         <nova:port uuid="53a43ee4-c532-49fb-b441-84020cd63e8a">
Apr 14 14:17:44 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 14:17:44 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:44 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:44 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:44 user nova-compute[71347]:   </metadata>
Apr 14 14:17:44 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:44 user nova-compute[71347]:     <system>
Apr 14 14:17:44 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:44 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:44 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:44 user nova-compute[71347]:       <entry name="serial">4d417e09-6e54-4cad-91e5-7910ee4e784a</entry>
Apr 14 14:17:44 user nova-compute[71347]:       <entry name="uuid">4d417e09-6e54-4cad-91e5-7910ee4e784a</entry>
Apr 14 14:17:44 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:44 user nova-compute[71347]:     </system>
Apr 14 14:17:44 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:44 user nova-compute[71347]:   <os>
Apr 14 14:17:44 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:44 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:44 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:44 user nova-compute[71347]:   </os>
Apr 14 14:17:44 user nova-compute[71347]:   <features>
Apr 14 14:17:44 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:44 user nova-compute[71347]:     <apic/>
Apr 14 14:17:44 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:44 user nova-compute[71347]:   </features>
Apr 14 14:17:44 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:44 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:44 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:44 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:44 user nova-compute[71347]:   </clock>
Apr 14 14:17:44 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:44 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:44 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:44 user nova-compute[71347]:   </cpu>
Apr 14 14:17:44 user nova-compute[71347]:   <devices>
Apr 14 14:17:44 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:44 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:44 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk"/>
Apr 14 14:17:44 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:44 user nova-compute[71347]:     </disk>
Apr 14 14:17:44 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:44 user nova-compute[71347]:       <mac address="fa:16:3e:2e:88:dd"/>
Apr 14 14:17:44 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:44 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:44 user nova-compute[71347]:       <target dev="tap53a43ee4-c5"/>
Apr 14 14:17:44 user nova-compute[71347]:     </interface>
Apr 14 14:17:44 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:44 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/console.log" append="off"/>
Apr 14 14:17:44 user nova-compute[71347]:     </serial>
Apr 14 14:17:44 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:44 user nova-compute[71347]:     <video>
Apr 14 14:17:44 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:44 user nova-compute[71347]:     </video>
Apr 14 14:17:44 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:44 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:44 user nova-compute[71347]:     </rng>
Apr 14 14:17:44 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:44 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:44 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:44 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:44 user nova-compute[71347]:   </devices>
Apr 14 14:17:44 user nova-compute[71347]: </domain>
Apr 14 14:17:44 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1181707762',display_name='tempest-TestVolumeSwap-server-1181707762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1181707762',id=9,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUHjZA/lLKTL8AYeb4MKZeMNC7337OmlBs6hgJc5vFrxuDLxwaaWgDr+nofdCoAuOjgQLOS5xfkD17Ozje4oKBUcPsZO+KEmoUYKmHrqoxiWCDi8m4XdobKcM0hp08pXg==',key_name='tempest-keypair-557766472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aab9855c5aa444fb8c1636fda0b2f394',ramdisk_id='',reservation_id='r-u57onffj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-306457705',owner_user_name='tempest-TestVolumeSwap-306457705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54c4c3585e74670adcb025cf9331844',uuid=4d417e09-6e54-4cad-91e5-7910ee4e784a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Converting VIF {"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:88:dd,bridge_name='br-int',has_traffic_filtering=True,id=53a43ee4-c532-49fb-b441-84020cd63e8a,network=Network(02d90be5-47ba-45f5-b49d-60de28b6639c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a43ee4-c5') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG os_vif [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:88:dd,bridge_name='br-int',has_traffic_filtering=True,id=53a43ee4-c532-49fb-b441-84020cd63e8a,network=Network(02d90be5-47ba-45f5-b49d-60de28b6639c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a43ee4-c5') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53a43ee4-c5, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53a43ee4-c5, col_values=(('external_ids', {'iface-id': '53a43ee4-c532-49fb-b441-84020cd63e8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:88:dd', 'vm-uuid': '4d417e09-6e54-4cad-91e5-7910ee4e784a'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:44 user nova-compute[71347]: INFO os_vif [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:88:dd,bridge_name='br-int',has_traffic_filtering=True,id=53a43ee4-c532-49fb-b441-84020cd63e8a,network=Network(02d90be5-47ba-45f5-b49d-60de28b6639c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a43ee4-c5')
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] No VIF found with MAC fa:16:3e:2e:88:dd, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG nova.network.neutron [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Updated VIF entry in instance network info cache for port 53a43ee4-c532-49fb-b441-84020cd63e8a. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG nova.network.neutron [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Updating instance_info_cache with network_info: [{"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4d15c2e7-de09-4790-baae-9208bebc797a req-26810d63-bae2-4acd-951e-2c1a7fa7d227 service nova] Releasing lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:45 user nova-compute[71347]: INFO nova.compute.claims [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Claim successful on node user
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received event network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] No waiting events found dispatching network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:46 user nova-compute[71347]: WARNING nova.compute.manager [req-4f52513f-74e1-43f6-a3b8-c928cef36c7d req-8293fdbc-4b76-4b4b-8b2e-71fe6d06d0ea service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received unexpected event network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 for instance with vm_state building and task_state spawning.
Apr 14 14:17:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.policy [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac3c91ffc9fe4c2a8afa04820908165a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f3e6748a8ce4ef0b22e272d19f6f584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Creating image(s)
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "/opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "/opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "/opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "93318da15a67c3a070e0f49dc44ebedae5c0f7b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "93318da15a67c3a070e0f49dc44ebedae5c0f7b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7.part --force-share --output=json" returned: 0 in 0.181s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG nova.virt.images [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 010c8455-e9db-4040-a35b-69e3a49846c7 was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7.part /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7.part /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7.converted" returned: 0 in 0.217s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "93318da15a67c3a070e0f49dc44ebedae5c0f7b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.980s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Successfully created port: 45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:17:47 user nova-compute[71347]: INFO nova.compute.claims [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Claim successful on node user
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7 --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "93318da15a67c3a070e0f49dc44ebedae5c0f7b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "93318da15a67c3a070e0f49dc44ebedae5c0f7b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7 --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7,backing_fmt=raw /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7,backing_fmt=raw /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk 1073741824" returned: 0 in 0.070s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "93318da15a67c3a070e0f49dc44ebedae5c0f7b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7 --force-share --output=json" returned: 0 in 0.182s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received event network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] No waiting events found dispatching network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:48 user nova-compute[71347]: WARNING nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received unexpected event network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 for instance with vm_state building and task_state spawning.
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received event network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] No waiting events found dispatching network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:48 user nova-compute[71347]: WARNING nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received unexpected event network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a for instance with vm_state building and task_state spawning.
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received event network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] No waiting events found dispatching network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:48 user nova-compute[71347]: WARNING nova.compute.manager [req-d576c0e3-c94c-4ac2-ab7a-6085dde08301 req-8316bebb-c187-4873-81f8-ff73ac10415f service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received unexpected event network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a for instance with vm_state building and task_state spawning.
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Cannot resize image /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lazy-loading 'migration_context' on Instance uuid 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Ensure instance console log exists: /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Successfully updated port: 45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquired lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received event network-changed-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Refreshing instance network info cache due to event network-changed-45351ca7-0534-4a7c-806b-71b0412f4e5d. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] Acquiring lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.policy [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:17:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Creating image(s)
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:17:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Updating instance_info_cache with network_info: [{"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481869.0515785, bc70d475-20dd-4859-a6fe-d2d09341799e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] VM Resumed (Lifecycle Event)
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Releasing lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Instance network_info: |[{"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] Acquired lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.neutron [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Refreshing network info cache for port 45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Start _get_guest_xml network_info=[{"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:17:37Z,direct_url=<?>,disk_format='qcow2',id=010c8455-e9db-4040-a35b-69e3a49846c7,min_disk=0,min_ram=0,name='',owner='dc9cb9f6cbfc4a36b5c81d97a1445f78',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:17:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': '010c8455-e9db-4040-a35b-69e3a49846c7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Instance spawned successfully.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:49 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:17:37Z,direct_url=<?>,disk_format='qcow2',id=010c8455-e9db-4040-a35b-69e3a49846c7,min_disk=0,min_ram=0,name='',owner='dc9cb9f6cbfc4a36b5c81d97a1445f78',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:17:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-979930942',display_name='tempest-AttachSCSIVolumeTestJSON-server-979930942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-979930942',id=10,image_ref='010c8455-e9db-4040-a35b-69e3a49846c7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0Dp/TpbyfNMr6nxhQGUMBOdgpBxSCjIxFTiVwhiVsHPSIl1rtj9HKlYO1jqlh/TGAWy9mUUVXXk78x6JPTXxgIeAN5njjb1VP1diJqaaSnKLXj1ax1f6JAViJUmDdFYw==',key_name='tempest-keypair-1781102291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f3e6748a8ce4ef0b22e272d19f6f584',ramdisk_id='',reservation_id='r-qer8jzre',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010c8455-e9db-4040-a35b-69e3a49846c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1519996642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1519996642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac3c91ffc9fe4c2a8afa04820908165a',uuid=14af0eec-8afa-4d4f-bc6a-3b04ff163e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Converting VIF {"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:cc:ea,bridge_name='br-int',has_traffic_filtering=True,id=45351ca7-0534-4a7c-806b-71b0412f4e5d,network=Network(3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45351ca7-05') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lazy-loading 'pci_devices' on Instance uuid 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481869.0532045, bc70d475-20dd-4859-a6fe-d2d09341799e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] VM Started (Lifecycle Event)
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.192s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:49 user nova-compute[71347]:   <uuid>14af0eec-8afa-4d4f-bc6a-3b04ff163e5d</uuid>
Apr 14 14:17:49 user nova-compute[71347]:   <name>instance-0000000a</name>
Apr 14 14:17:49 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:49 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:49 user nova-compute[71347]:   <metadata>
Apr 14 14:17:49 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:49 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:49 user nova-compute[71347]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-979930942</nova:name>
Apr 14 14:17:49 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:49</nova:creationTime>
Apr 14 14:17:49 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:49 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:49 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:49 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:49 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:49 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:49 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:49 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:49 user nova-compute[71347]:         <nova:user uuid="ac3c91ffc9fe4c2a8afa04820908165a">tempest-AttachSCSIVolumeTestJSON-1519996642-project-member</nova:user>
Apr 14 14:17:49 user nova-compute[71347]:         <nova:project uuid="8f3e6748a8ce4ef0b22e272d19f6f584">tempest-AttachSCSIVolumeTestJSON-1519996642</nova:project>
Apr 14 14:17:49 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:49 user nova-compute[71347]:       <nova:root type="image" uuid="010c8455-e9db-4040-a35b-69e3a49846c7"/>
Apr 14 14:17:49 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:49 user nova-compute[71347]:         <nova:port uuid="45351ca7-0534-4a7c-806b-71b0412f4e5d">
Apr 14 14:17:49 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:17:49 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:49 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:49 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:49 user nova-compute[71347]:   </metadata>
Apr 14 14:17:49 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:49 user nova-compute[71347]:     <system>
Apr 14 14:17:49 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:49 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:49 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:49 user nova-compute[71347]:       <entry name="serial">14af0eec-8afa-4d4f-bc6a-3b04ff163e5d</entry>
Apr 14 14:17:49 user nova-compute[71347]:       <entry name="uuid">14af0eec-8afa-4d4f-bc6a-3b04ff163e5d</entry>
Apr 14 14:17:49 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:49 user nova-compute[71347]:     </system>
Apr 14 14:17:49 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:49 user nova-compute[71347]:   <os>
Apr 14 14:17:49 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:49 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:49 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:49 user nova-compute[71347]:   </os>
Apr 14 14:17:49 user nova-compute[71347]:   <features>
Apr 14 14:17:49 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:49 user nova-compute[71347]:     <apic/>
Apr 14 14:17:49 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:49 user nova-compute[71347]:   </features>
Apr 14 14:17:49 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:49 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:49 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:49 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:49 user nova-compute[71347]:   </clock>
Apr 14 14:17:49 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:49 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:49 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:49 user nova-compute[71347]:   </cpu>
Apr 14 14:17:49 user nova-compute[71347]:   <devices>
Apr 14 14:17:49 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:49 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:49 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk"/>
Apr 14 14:17:49 user nova-compute[71347]:       <target dev="sda" bus="scsi"/>
Apr 14 14:17:49 user nova-compute[71347]:       <address type="drive" controller="0" unit="0"/>
Apr 14 14:17:49 user nova-compute[71347]:     </disk>
Apr 14 14:17:49 user nova-compute[71347]:     <disk type="file" device="cdrom">
Apr 14 14:17:49 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 14:17:49 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk.config"/>
Apr 14 14:17:49 user nova-compute[71347]:       <target dev="sdb" bus="scsi"/>
Apr 14 14:17:49 user nova-compute[71347]:       <address type="drive" controller="0" unit="1"/>
Apr 14 14:17:49 user nova-compute[71347]:     </disk>
Apr 14 14:17:49 user nova-compute[71347]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 14:17:49 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:49 user nova-compute[71347]:       <mac address="fa:16:3e:3d:cc:ea"/>
Apr 14 14:17:49 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:49 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:49 user nova-compute[71347]:       <target dev="tap45351ca7-05"/>
Apr 14 14:17:49 user nova-compute[71347]:     </interface>
Apr 14 14:17:49 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:49 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/console.log" append="off"/>
Apr 14 14:17:49 user nova-compute[71347]:     </serial>
Apr 14 14:17:49 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:49 user nova-compute[71347]:     <video>
Apr 14 14:17:49 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:49 user nova-compute[71347]:     </video>
Apr 14 14:17:49 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:49 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:49 user nova-compute[71347]:     </rng>
Apr 14 14:17:49 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:49 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:49 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:49 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:49 user nova-compute[71347]:   </devices>
Apr 14 14:17:49 user nova-compute[71347]: </domain>
Apr 14 14:17:49 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-979930942',display_name='tempest-AttachSCSIVolumeTestJSON-server-979930942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-979930942',id=10,image_ref='010c8455-e9db-4040-a35b-69e3a49846c7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0Dp/TpbyfNMr6nxhQGUMBOdgpBxSCjIxFTiVwhiVsHPSIl1rtj9HKlYO1jqlh/TGAWy9mUUVXXk78x6JPTXxgIeAN5njjb1VP1diJqaaSnKLXj1ax1f6JAViJUmDdFYw==',key_name='tempest-keypair-1781102291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f3e6748a8ce4ef0b22e272d19f6f584',ramdisk_id='',reservation_id='r-qer8jzre',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010c8455-e9db-4040-a35b-69e3a49846c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1519996642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1519996642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac3c91ffc9fe4c2a8afa04820908165a',uuid=14af0eec-8afa-4d4f-bc6a-3b04ff163e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Converting VIF {"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:cc:ea,bridge_name='br-int',has_traffic_filtering=True,id=45351ca7-0534-4a7c-806b-71b0412f4e5d,network=Network(3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45351ca7-05') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG os_vif [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:cc:ea,bridge_name='br-int',has_traffic_filtering=True,id=45351ca7-0534-4a7c-806b-71b0412f4e5d,network=Network(3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45351ca7-05') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Took 10.15 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk 1073741824" returned: 0 in 0.074s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45351ca7-05, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45351ca7-05, col_values=(('external_ids', {'iface-id': '45351ca7-0534-4a7c-806b-71b0412f4e5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:cc:ea', 'vm-uuid': '14af0eec-8afa-4d4f-bc6a-3b04ff163e5d'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:49 user nova-compute[71347]: INFO os_vif [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:cc:ea,bridge_name='br-int',has_traffic_filtering=True,id=45351ca7-0534-4a7c-806b-71b0412f4e5d,network=Network(3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45351ca7-05')
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Instance spawned successfully.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481869.2467747, 4d417e09-6e54-4cad-91e5-7910ee4e784a => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] VM Resumed (Lifecycle Event)
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Successfully created port: 93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Took 12.04 seconds to build instance.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] No BDM found with device name sda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] No VIF found with MAC fa:16:3e:3d:cc:ea, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Using config drive
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.220s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bd76801d-5947-4f2d-9f2d-778ec7b54aec tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.239s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Took 7.79 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481869.252054, 4d417e09-6e54-4cad-91e5-7910ee4e784a => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] VM Started (Lifecycle Event)
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Cannot resize image /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'migration_context' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Ensure instance console log exists: /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.compute.manager [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Took 9.19 seconds to build instance.
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-10e7d4ba-d6e6-437f-8a00-a0160a2fa41a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.379s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.neutron [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Updated VIF entry in instance network info cache for port 45351ca7-0534-4a7c-806b-71b0412f4e5d. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG nova.network.neutron [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Updating instance_info_cache with network_info: [{"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-456fea6a-4d90-4b69-aefa-21987a4a085f req-1e034a18-e882-4026-b172-ba7245664ee4 service nova] Releasing lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Creating config drive at /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk.config
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpg33q9a6t {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:17:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpg33q9a6t" returned: 0 in 0.068s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Successfully updated port: 93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquired lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-changed-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Refreshing instance network info cache due to event network-changed-93ca09be-6bf7-49fb-873a-b3236618a784. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] Acquiring lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating instance_info_cache with network_info: [{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Releasing lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Instance network_info: |[{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] Acquired lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.network.neutron [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Refreshing network info cache for port 93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Start _get_guest_xml network_info=[{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:17:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:17:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converting VIF {"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:76:28,bridge_name='br-int',has_traffic_filtering=True,id=93ca09be-6bf7-49fb-873a-b3236618a784,network=Network(241db769-30f2-408d-80e1-f7bc96865f9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ca09be-6b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'pci_devices' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:17:51 user nova-compute[71347]:   <uuid>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</uuid>
Apr 14 14:17:51 user nova-compute[71347]:   <name>instance-0000000b</name>
Apr 14 14:17:51 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:17:51 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:17:51 user nova-compute[71347]:   <metadata>
Apr 14 14:17:51 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:17:51 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:17:51 user nova-compute[71347]:       <nova:name>tempest-device-tagging-server-1619832572</nova:name>
Apr 14 14:17:51 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:17:50</nova:creationTime>
Apr 14 14:17:51 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:17:51 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:17:51 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:17:51 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:17:51 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:17:51 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:17:51 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:17:51 user nova-compute[71347]:       <nova:owner>
Apr 14 14:17:51 user nova-compute[71347]:         <nova:user uuid="ec166aaa170041c1a486379c7f417e66">tempest-TaggedAttachmentsTest-804560801-project-member</nova:user>
Apr 14 14:17:51 user nova-compute[71347]:         <nova:project uuid="d6bca3db8fa34f948a25621d348995f4">tempest-TaggedAttachmentsTest-804560801</nova:project>
Apr 14 14:17:51 user nova-compute[71347]:       </nova:owner>
Apr 14 14:17:51 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:17:51 user nova-compute[71347]:       <nova:ports>
Apr 14 14:17:51 user nova-compute[71347]:         <nova:port uuid="93ca09be-6bf7-49fb-873a-b3236618a784">
Apr 14 14:17:51 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:17:51 user nova-compute[71347]:         </nova:port>
Apr 14 14:17:51 user nova-compute[71347]:       </nova:ports>
Apr 14 14:17:51 user nova-compute[71347]:     </nova:instance>
Apr 14 14:17:51 user nova-compute[71347]:   </metadata>
Apr 14 14:17:51 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:17:51 user nova-compute[71347]:     <system>
Apr 14 14:17:51 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:17:51 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:17:51 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:17:51 user nova-compute[71347]:       <entry name="serial">dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:17:51 user nova-compute[71347]:       <entry name="uuid">dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:17:51 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:17:51 user nova-compute[71347]:     </system>
Apr 14 14:17:51 user nova-compute[71347]:   </sysinfo>
Apr 14 14:17:51 user nova-compute[71347]:   <os>
Apr 14 14:17:51 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:17:51 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:17:51 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:17:51 user nova-compute[71347]:   </os>
Apr 14 14:17:51 user nova-compute[71347]:   <features>
Apr 14 14:17:51 user nova-compute[71347]:     <acpi/>
Apr 14 14:17:51 user nova-compute[71347]:     <apic/>
Apr 14 14:17:51 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:17:51 user nova-compute[71347]:   </features>
Apr 14 14:17:51 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:17:51 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:17:51 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:17:51 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:17:51 user nova-compute[71347]:   </clock>
Apr 14 14:17:51 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:17:51 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:17:51 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:17:51 user nova-compute[71347]:   </cpu>
Apr 14 14:17:51 user nova-compute[71347]:   <devices>
Apr 14 14:17:51 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:17:51 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:17:51 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk"/>
Apr 14 14:17:51 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:17:51 user nova-compute[71347]:     </disk>
Apr 14 14:17:51 user nova-compute[71347]:     <disk type="file" device="cdrom">
Apr 14 14:17:51 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 14:17:51 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.config"/>
Apr 14 14:17:51 user nova-compute[71347]:       <target dev="hda" bus="ide"/>
Apr 14 14:17:51 user nova-compute[71347]:     </disk>
Apr 14 14:17:51 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:17:51 user nova-compute[71347]:       <mac address="fa:16:3e:cf:76:28"/>
Apr 14 14:17:51 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:51 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:17:51 user nova-compute[71347]:       <target dev="tap93ca09be-6b"/>
Apr 14 14:17:51 user nova-compute[71347]:     </interface>
Apr 14 14:17:51 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:17:51 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log" append="off"/>
Apr 14 14:17:51 user nova-compute[71347]:     </serial>
Apr 14 14:17:51 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:17:51 user nova-compute[71347]:     <video>
Apr 14 14:17:51 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:17:51 user nova-compute[71347]:     </video>
Apr 14 14:17:51 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:17:51 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:17:51 user nova-compute[71347]:     </rng>
Apr 14 14:17:51 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:17:51 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:17:51 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:17:51 user nova-compute[71347]:     </memballoon>
Apr 14 14:17:51 user nova-compute[71347]:   </devices>
Apr 14 14:17:51 user nova-compute[71347]: </domain>
Apr 14 14:17:51 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converting VIF {"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:76:28,bridge_name='br-int',has_traffic_filtering=True,id=93ca09be-6bf7-49fb-873a-b3236618a784,network=Network(241db769-30f2-408d-80e1-f7bc96865f9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ca09be-6b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG os_vif [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:76:28,bridge_name='br-int',has_traffic_filtering=True,id=93ca09be-6bf7-49fb-873a-b3236618a784,network=Network(241db769-30f2-408d-80e1-f7bc96865f9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ca09be-6b') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93ca09be-6b, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93ca09be-6b, col_values=(('external_ids', {'iface-id': '93ca09be-6bf7-49fb-873a-b3236618a784', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:76:28', 'vm-uuid': 'dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:51 user nova-compute[71347]: INFO os_vif [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:76:28,bridge_name='br-int',has_traffic_filtering=True,id=93ca09be-6bf7-49fb-873a-b3236618a784,network=Network(241db769-30f2-408d-80e1-f7bc96865f9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ca09be-6b')
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No BDM found with device name hda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No VIF found with MAC fa:16:3e:cf:76:28, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:17:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Using config drive
Apr 14 14:17:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Creating config drive at /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.config
Apr 14 14:17:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgqa4ev88 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgqa4ev88" returned: 0 in 0.065s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updated VIF entry in instance network info cache for port 93ca09be-6bf7-49fb-873a-b3236618a784. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating instance_info_cache with network_info: [{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8eca7ef-b07f-4d73-8fbd-5f833a97642e req-a98aeb56-9e76-4456-b647-8bc8555a22ee service nova] Releasing lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received event network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] No waiting events found dispatching network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:52 user nova-compute[71347]: WARNING nova.compute.manager [req-05b3218d-c41c-499a-baf3-4f129a291d69 req-10078885-7c86-484e-acd5-8068a2b50fda service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received unexpected event network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d for instance with vm_state building and task_state spawning.
Apr 14 14:17:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] No waiting events found dispatching network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:54 user nova-compute[71347]: WARNING nova.compute.manager [req-f952995d-e943-4be0-b76c-6b06cf66f3d5 req-7e6e4620-d7b2-4dbb-be95-6162cb83a666 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received unexpected event network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 for instance with vm_state building and task_state spawning.
Apr 14 14:17:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received event network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] No waiting events found dispatching network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:54 user nova-compute[71347]: WARNING nova.compute.manager [req-b186335c-c649-4dee-91aa-8d184b212aec req-92a05172-7ff3-4514-a281-7735667b8994 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received unexpected event network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d for instance with vm_state building and task_state spawning.
Apr 14 14:17:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481875.7503085, 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] VM Resumed (Lifecycle Event)
Apr 14 14:17:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Instance spawned successfully.
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481875.7507408, 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] VM Started (Lifecycle Event)
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481875.950709, dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] VM Resumed (Lifecycle Event)
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:17:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Instance spawned successfully.
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481875.9547644, dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:17:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] VM Started (Lifecycle Event)
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:56 user nova-compute[71347]: INFO nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Took 9.37 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] No waiting events found dispatching network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:17:56 user nova-compute[71347]: WARNING nova.compute.manager [req-cceaf29e-c9a0-42bd-848b-116d78511b64 req-c7905008-0613-44a2-aec6-377085e7abc2 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received unexpected event network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 for instance with vm_state building and task_state spawning.
Apr 14 14:17:56 user nova-compute[71347]: INFO nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Took 7.31 seconds to spawn the instance on the hypervisor.
Apr 14 14:17:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:17:56 user nova-compute[71347]: INFO nova.compute.manager [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Took 10.45 seconds to build instance.
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:56 user nova-compute[71347]: INFO nova.compute.manager [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Took 8.55 seconds to build instance.
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c2ed011d-1a6f-4257-856b-60701fb9b7c6 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.646s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ba325870-6f0e-4492-a0c0-718e42531e52 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.752s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:17:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:00 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:18:00 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:18:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=26.790313720703125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:18:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 06baebb6-4922-4d82-b396-48bf76c60f2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance bc70d475-20dd-4859-a6fe-d2d09341799e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e81e92d6-b79e-46db-b69e-1f7584440287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:18:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.969s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:18:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updating instance_info_cache with network_info: [{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:18:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "56967036-c176-4423-aa3e-c78ee4e364ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:18:19 user nova-compute[71347]: INFO nova.compute.claims [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Claim successful on node user
Apr 14 14:18:19 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:18:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:18:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:18:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:18:20 user nova-compute[71347]: INFO nova.virt.block_device [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Booting with volume 7122a873-6fa1-4dab-80ba-8ba4d9804896 at /dev/vda
Apr 14 14:18:20 user nova-compute[71347]: DEBUG nova.policy [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c520c20d1b9f43dc8bf2517dffd76bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da7ba7bdb124c3880e3394d3bbab296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:18:20 user nova-compute[71347]: DEBUG os_brick.utils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:18:20 user nova-compute[71347]: INFO oslo.privsep.daemon [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptyx7hntt/privsep.sock']
Apr 14 14:18:20 user sudo[82019]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptyx7hntt/privsep.sock
Apr 14 14:18:20 user sudo[82019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 14:18:20 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully created port: 6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:18:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully created port: 3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:18:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully created port: 2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:18:21 user sudo[82019]: pam_unix(sudo:session): session closed for user root
Apr 14 14:18:21 user nova-compute[71347]: INFO oslo.privsep.daemon [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Spawned new privsep daemon via rootwrap
Apr 14 14:18:21 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 14:18:21 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 14:18:21 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 14:18:21 user nova-compute[71347]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82022
Apr 14 14:18:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71d20a3-8f1c-46f4-ac34-28893f5a1060]: (2,) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[985ae0bc-5a98-4dd4-8f13-eaa6c1744a9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:22 user nova-compute[71347]: WARNING os_brick.initiator.connectors.nvmeof [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d55299c-4615-4ace-8230-2b36871b698f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b06f6-80a7-4782-94ac-55a6bf0ac526]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83505b6-73ea-447a-8b63-5f353837bc08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:18:22 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:18:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cecac5d-5df4-4425-9f12-69ab44823964]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG os_brick.utils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== get_connector_properties: return (1908ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating existing volume attachment record: dc97d1a4-f1bb-4267-8574-b02d9f975bf9 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully created port: e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:18:23 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully created port: 7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully updated port: 6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-changed-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing instance network info cache due to event network-changed-6b29f14f-01b4-49bc-80ff-6e0a062c47a2. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG nova.network.neutron [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing network info cache for port 6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG nova.network.neutron [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG nova.network.neutron [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1dbda60a-ea9d-4a29-b7d6-7f2528fef0a7 req-1894b3c5-4446-4eb7-9446-94ae0a6900bf service nova] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:25 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully updated port: cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:18:25 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully updated port: d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:18:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-changed-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing instance network info cache due to event network-changed-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:18:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing network info cache for port cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:18:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully updated port: 3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:18:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:18:27 user nova-compute[71347]: INFO nova.virt.block_device [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Booting with volume 9c212e76-aa19-4748-8d6a-475e52283dda at /dev/vdb
Apr 14 14:18:27 user nova-compute[71347]: DEBUG nova.network.neutron [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-changed-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing instance network info cache due to event network-changed-d6821969-0f10-4fd6-9c25-0a52e658eca6. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG nova.network.neutron [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing network info cache for port d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG os_brick.utils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c8097b-7be1-4bfe-866b-a6662640b5b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[83744a82-31ce-4584-9fb0-713298fb80f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG nova.network.neutron [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6213568-c761-406a-b467-c6aa41b9277f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a0ada4-bac2-413a-b701-03502b01b78b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:18:27 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4dbf97-793c-4a5c-bf57-fc9739e4f3ab]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG os_brick.utils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating existing volume attachment record: 6065bdc0-a8b3-4006-a90b-84a6f8d0166b {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG nova.network.neutron [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bdc20c0-3014-4d18-810c-902be92e5511 req-a1b78c82-5da0-409b-afa5-1bc16211d2f6 service nova] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully updated port: 2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:18:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully updated port: e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-changed-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing instance network info cache due to event network-changed-3bfcc6b7-6768-47b7-ae40-f951761442a5. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing network info cache for port 3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-changed-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing instance network info cache due to event network-changed-2f7a292d-75de-404e-bb4c-93e2bc9d190b. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing network info cache for port 2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:18:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Successfully updated port: 7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-changed-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing instance network info cache due to event network-changed-e060de39-0ed8-4aa3-9046-222f9254ddfe. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing network info cache for port e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b963a23-2723-4d17-9702-63248240cee6 req-73cbff9b-5fe8-41dc-8c28-bdde27f1361a service nova] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:18:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:18:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-changed-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing instance network info cache due to event network-changed-7923b754-a636-4e91-b166-ce9b0c0fce99. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:18:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:31 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [{"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance network_info: |[{"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:18:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:31 user nova-compute[71347]: DEBUG nova.network.neutron [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing network info cache for port 7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:18:32 user nova-compute[71347]: INFO nova.virt.block_device [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Booting with volume c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 at /dev/vdc
Apr 14 14:18:32 user nova-compute[71347]: DEBUG os_brick.utils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b493d8af-af97-4d9f-9ecc-59b249928c49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657bf37-9ed2-4fb3-8739-6f9d0d093199]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2e0c9b-961f-4553-8dba-f9c7835eea30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[260ca165-656e-4bdb-97cc-52c46b27408f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:18:32 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53da80c-5cec-408e-861a-dab2eac93434]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG os_brick.utils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating existing volume attachment record: c50dab98-ed8b-4d98-89d3-861d6ff8918b {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG nova.network.neutron [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updated VIF entry in instance network info cache for port 7923b754-a636-4e91-b166-ce9b0c0fce99. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG nova.network.neutron [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [{"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e79bb7a3-6b79-4031-ad0b-798e14ee1ba4 req-1afd03fd-b8a4-4c5d-a90a-6c51ae3ccf31 service nova] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:18:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Creating image(s)
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Ensure instance console log exists: /opt/stack/data/nova/instances/56967036-c176-4423-aa3e-c78ee4e364ac/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Start _get_guest_xml network_info=[{"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNgJjElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56967036-c176-4423-aa3e-c78ee4e364ac', 'attached_at': '', 'detached_at': '', 'volume_id': '7122a873-6fa1-4dab-80ba-8ba4d9804896', 'serial': '7122a873-6fa1-4dab-80ba-8ba4d9804896'}, 'attachment_id': 'dc97d1a4-f1bb-4267-8574-b02d9f975bf9', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIpFjHwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56967036-c176-4423-aa3e-c78ee4e364ac', 'attached_at': '', 'detached_at': '', 'volume_id': '9c212e76-aa19-4748-8d6a-475e52283dda', 'serial': '9c212e76-aa19-4748-8d6a-475e52283dda'}, 'attachment_id': '6065bdc0-a8b3-4006-a90b-84a6f8d0166b', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebExoRBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56967036-c176-4423-aa3e-c78ee4e364ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5', 'serial': 'c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5'}, 'attachment_id': 'c50dab98-ed8b-4d98-89d3-861d6ff8918b', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:18:37 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:18:37 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connector [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Factory for ISCSI on None {{(pid=71347) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNgJjElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:18:37 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:18:37 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:18:37 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:18:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceca6338-c929-47ad-91bb-1ca76a84ca1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:18:37 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d41a4a3-02e0-4786-baac-b95584f87e54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896] added
Apr 14 14:18:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[27399b89-1933-4e38-b35d-13859e610311]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c9589d-9887-4531-b722-678c56f12770]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNgJjElo {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNgJjElo" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b617f96-0f61-4783-ad7b-47c1b3fd8e36]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNgJjElo'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7490d89-0776-46ee-a702-361aa27fa092]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a97ab-13c4-4e09-a086-f4c4e9597fe0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:18:37 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:18:37 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:18:37 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:18:37 user nova-compute[71347]: 
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7487a9-cae6-405a-baad-80db8b923f47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896, portal: 172.16.0.220,3260]
Apr 14 14:18:37 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896, portal: 172.16.0.220,3260] successful.
Apr 14 14:18:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[178dd156-d51b-49f6-bd48-836eb367fad6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1327a3d0-7e1d-4e1b-8400-3e07ca728919]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec147de-a5c3-4729-aa7f-d5f854aef44a]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:18:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNgJjElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23861313835656663', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861313835656663', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIpFjHwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:18:38 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:18:38 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:18:38 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a3184-83db-41e9-b3cd-2d599671aa1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:18:38 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e994bcc-41f2-4042-ae70-abfaa17aef79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda] added
Apr 14 14:18:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5547e08e-c8af-45fb-9979-9099c9374276]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[049b9310-db6e-40f7-ac91-85e8be7d81d2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hIpFjHwe {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hIpFjHwe" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[888073a0-955a-415e-bead-46ff3350ddf6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hIpFjHwe'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e494352-35c0-4a9d-a719-efbf47d02afd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b30316-5521-4060-8711-e5feea262746]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:39 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:39 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c1c8b-1497-4e20-896f-b4f545eeff07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda, portal: 172.16.0.220,3260]
Apr 14 14:18:39 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda, portal: 172.16.0.220,3260] successful.
Apr 14 14:18:39 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4fbb12-c307-4f0b-b070-3a0dc3ee699f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2befe0f-47ed-4e72-9249-b2fc5e9fcb01]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:39 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:18:39 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:39 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:18:39 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad701fcf-be3f-4861-99e2-5da5be5a66b8]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:18:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIpFjHwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23766313233666534', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766313233666534', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebExoRBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:18:40 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:18:40 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:18:40 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac1d55c-5149-4503-bd4f-8e193bfcb112]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:18:40 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c9dc9-3e81-43a5-bc61-73e38c349eeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5] added
Apr 14 14:18:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4897a23b-470e-4af9-a6ad-6161b5af2787]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd9ebc-7204-43f3-b24f-11c8a42ff7c4]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebExoRBv {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ebExoRBv" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e697338-f899-4ffe-8234-c02196f3cf83]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ebExoRBv'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d949549-2327-49ab-b88e-7df131567abe]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0982cf2-5d86-445d-85ce-94fbad5df1b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:40 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:18:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:40 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:18:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b66968-3b17-4bd8-9cef-91947f0de312]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5, portal: 172.16.0.220,3260]
Apr 14 14:18:40 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5, portal: 172.16.0.220,3260] successful.
Apr 14 14:18:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4358d4-3374-4ff1-aa32-90bafa9d2d04]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4941c84e-3716-477f-bb0a-e3dc2dff0d43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:40 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:18:40 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:18:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:18:40 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:18:40 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:18:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e19c8c-a6cb-4750-a162-9c5c13baeeca]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:18:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebExoRBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23534326633313635', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534326633313635', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=6b29f14f-01b4-49bc-80ff-6e0a062c47a2,network=Network(5d0243d2-2246-4474-a20b-7456780b2a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b29f14f-01') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=cc5e8a3d-7a5f-4cd7-907b-6c91f479b371,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc5e8a3d-7a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a0:1b,bridge_name='br-int',has_traffic_filtering=True,id=d6821969-0f10-4fd6-9c25-0a52e658eca6,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6821969-0f') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:7f,bridge_name='br-int',has_traffic_filtering=True,id=3bfcc6b7-6768-47b7-ae40-f951761442a5,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfcc6b7-67') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=2f7a292d-75de-404e-bb4c-93e2bc9d190b,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7a292d-75') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f5:b1,bridge_name='br-int',has_traffic_filtering=True,id=e060de39-0ed8-4aa3-9046-222f9254ddfe,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060de39-0e') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:e0,bridge_name='br-int',has_traffic_filtering=True,id=7923b754-a636-4e91-b166-ce9b0c0fce99,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7923b754-a6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lazy-loading 'pci_devices' on Instance uuid 56967036-c176-4423-aa3e-c78ee4e364ac {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:18:41 user nova-compute[71347]:   <uuid>56967036-c176-4423-aa3e-c78ee4e364ac</uuid>
Apr 14 14:18:41 user nova-compute[71347]:   <name>instance-0000000c</name>
Apr 14 14:18:41 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:18:41 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:18:41 user nova-compute[71347]:   <metadata>
Apr 14 14:18:41 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:18:41 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:18:41 user nova-compute[71347]:       <nova:name>tempest-device-tagging-server-1806973002</nova:name>
Apr 14 14:18:41 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:18:37</nova:creationTime>
Apr 14 14:18:41 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:18:41 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:18:41 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:18:41 user nova-compute[71347]:       <nova:owner>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:user uuid="c520c20d1b9f43dc8bf2517dffd76bea">tempest-TaggedBootDevicesTest_v242-1582702370-project-member</nova:user>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:project uuid="1da7ba7bdb124c3880e3394d3bbab296">tempest-TaggedBootDevicesTest_v242-1582702370</nova:project>
Apr 14 14:18:41 user nova-compute[71347]:       </nova:owner>
Apr 14 14:18:41 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:18:41 user nova-compute[71347]:       <nova:ports>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:port uuid="6b29f14f-01b4-49bc-80ff-6e0a062c47a2">
Apr 14 14:18:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 14:18:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:port uuid="cc5e8a3d-7a5f-4cd7-907b-6c91f479b371">
Apr 14 14:18:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.1.1.114" ipVersion="4"/>
Apr 14 14:18:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:port uuid="d6821969-0f10-4fd6-9c25-0a52e658eca6">
Apr 14 14:18:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.1.1.242" ipVersion="4"/>
Apr 14 14:18:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:port uuid="3bfcc6b7-6768-47b7-ae40-f951761442a5">
Apr 14 14:18:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.1.1.189" ipVersion="4"/>
Apr 14 14:18:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:port uuid="2f7a292d-75de-404e-bb4c-93e2bc9d190b">
Apr 14 14:18:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
Apr 14 14:18:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:port uuid="e060de39-0ed8-4aa3-9046-222f9254ddfe">
Apr 14 14:18:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 14:18:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:18:41 user nova-compute[71347]:         <nova:port uuid="7923b754-a636-4e91-b166-ce9b0c0fce99">
Apr 14 14:18:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 14:18:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:18:41 user nova-compute[71347]:       </nova:ports>
Apr 14 14:18:41 user nova-compute[71347]:     </nova:instance>
Apr 14 14:18:41 user nova-compute[71347]:   </metadata>
Apr 14 14:18:41 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:18:41 user nova-compute[71347]:     <system>
Apr 14 14:18:41 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:18:41 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:18:41 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:18:41 user nova-compute[71347]:       <entry name="serial">56967036-c176-4423-aa3e-c78ee4e364ac</entry>
Apr 14 14:18:41 user nova-compute[71347]:       <entry name="uuid">56967036-c176-4423-aa3e-c78ee4e364ac</entry>
Apr 14 14:18:41 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:18:41 user nova-compute[71347]:     </system>
Apr 14 14:18:41 user nova-compute[71347]:   </sysinfo>
Apr 14 14:18:41 user nova-compute[71347]:   <os>
Apr 14 14:18:41 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:18:41 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:18:41 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:18:41 user nova-compute[71347]:   </os>
Apr 14 14:18:41 user nova-compute[71347]:   <features>
Apr 14 14:18:41 user nova-compute[71347]:     <acpi/>
Apr 14 14:18:41 user nova-compute[71347]:     <apic/>
Apr 14 14:18:41 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:18:41 user nova-compute[71347]:   </features>
Apr 14 14:18:41 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:18:41 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:18:41 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:18:41 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:18:41 user nova-compute[71347]:   </clock>
Apr 14 14:18:41 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:18:41 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:18:41 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:18:41 user nova-compute[71347]:   </cpu>
Apr 14 14:18:41 user nova-compute[71347]:   <devices>
Apr 14 14:18:41 user nova-compute[71347]:     <disk type="file" device="cdrom">
Apr 14 14:18:41 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 14:18:41 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/56967036-c176-4423-aa3e-c78ee4e364ac/disk.config"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="hda" bus="ide"/>
Apr 14 14:18:41 user nova-compute[71347]:     </disk>
Apr 14 14:18:41 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:18:41 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:18:41 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <serial>7122a873-6fa1-4dab-80ba-8ba4d9804896</serial>
Apr 14 14:18:41 user nova-compute[71347]:     </disk>
Apr 14 14:18:41 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:18:41 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:18:41 user nova-compute[71347]:       <source dev="/dev/sdc"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <serial>9c212e76-aa19-4748-8d6a-475e52283dda</serial>
Apr 14 14:18:41 user nova-compute[71347]:     </disk>
Apr 14 14:18:41 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:18:41 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:18:41 user nova-compute[71347]:       <source dev="/dev/sdd"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="vdc" bus="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <serial>c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5</serial>
Apr 14 14:18:41 user nova-compute[71347]:     </disk>
Apr 14 14:18:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:18:41 user nova-compute[71347]:       <mac address="fa:16:3e:51:c9:1a"/>
Apr 14 14:18:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="tap6b29f14f-01"/>
Apr 14 14:18:41 user nova-compute[71347]:     </interface>
Apr 14 14:18:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:18:41 user nova-compute[71347]:       <mac address="fa:16:3e:3f:56:eb"/>
Apr 14 14:18:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="tapcc5e8a3d-7a"/>
Apr 14 14:18:41 user nova-compute[71347]:     </interface>
Apr 14 14:18:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:18:41 user nova-compute[71347]:       <mac address="fa:16:3e:30:a0:1b"/>
Apr 14 14:18:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="tapd6821969-0f"/>
Apr 14 14:18:41 user nova-compute[71347]:     </interface>
Apr 14 14:18:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:18:41 user nova-compute[71347]:       <mac address="fa:16:3e:e1:3f:7f"/>
Apr 14 14:18:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="tap3bfcc6b7-67"/>
Apr 14 14:18:41 user nova-compute[71347]:     </interface>
Apr 14 14:18:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:18:41 user nova-compute[71347]:       <mac address="fa:16:3e:46:6e:45"/>
Apr 14 14:18:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="tap2f7a292d-75"/>
Apr 14 14:18:41 user nova-compute[71347]:     </interface>
Apr 14 14:18:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:18:41 user nova-compute[71347]:       <mac address="fa:16:3e:1e:f5:b1"/>
Apr 14 14:18:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="tape060de39-0e"/>
Apr 14 14:18:41 user nova-compute[71347]:     </interface>
Apr 14 14:18:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:18:41 user nova-compute[71347]:       <mac address="fa:16:3e:2a:ca:e0"/>
Apr 14 14:18:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:18:41 user nova-compute[71347]:       <target dev="tap7923b754-a6"/>
Apr 14 14:18:41 user nova-compute[71347]:     </interface>
Apr 14 14:18:41 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:18:41 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/56967036-c176-4423-aa3e-c78ee4e364ac/console.log" append="off"/>
Apr 14 14:18:41 user nova-compute[71347]:     </serial>
Apr 14 14:18:41 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:18:41 user nova-compute[71347]:     <video>
Apr 14 14:18:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:41 user nova-compute[71347]:     </video>
Apr 14 14:18:41 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:18:41 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:18:41 user nova-compute[71347]:     </rng>
Apr 14 14:18:41 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:18:41 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:18:41 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:18:41 user nova-compute[71347]:     </memballoon>
Apr 14 14:18:41 user nova-compute[71347]:   </devices>
Apr 14 14:18:41 user nova-compute[71347]: </domain>
Apr 14 14:18:41 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=6b29f14f-01b4-49bc-80ff-6e0a062c47a2,network=Network(5d0243d2-2246-4474-a20b-7456780b2a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b29f14f-01') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=6b29f14f-01b4-49bc-80ff-6e0a062c47a2,network=Network(5d0243d2-2246-4474-a20b-7456780b2a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b29f14f-01') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b29f14f-01, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b29f14f-01, col_values=(('external_ids', {'iface-id': '6b29f14f-01b4-49bc-80ff-6e0a062c47a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:c9:1a', 'vm-uuid': '56967036-c176-4423-aa3e-c78ee4e364ac'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: INFO os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=6b29f14f-01b4-49bc-80ff-6e0a062c47a2,network=Network(5d0243d2-2246-4474-a20b-7456780b2a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b29f14f-01')
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=cc5e8a3d-7a5f-4cd7-907b-6c91f479b371,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc5e8a3d-7a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=cc5e8a3d-7a5f-4cd7-907b-6c91f479b371,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc5e8a3d-7a') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc5e8a3d-7a, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc5e8a3d-7a, col_values=(('external_ids', {'iface-id': 'cc5e8a3d-7a5f-4cd7-907b-6c91f479b371', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:56:eb', 'vm-uuid': '56967036-c176-4423-aa3e-c78ee4e364ac'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: INFO os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=cc5e8a3d-7a5f-4cd7-907b-6c91f479b371,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc5e8a3d-7a')
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a0:1b,bridge_name='br-int',has_traffic_filtering=True,id=d6821969-0f10-4fd6-9c25-0a52e658eca6,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6821969-0f') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a0:1b,bridge_name='br-int',has_traffic_filtering=True,id=d6821969-0f10-4fd6-9c25-0a52e658eca6,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6821969-0f') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6821969-0f, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6821969-0f, col_values=(('external_ids', {'iface-id': 'd6821969-0f10-4fd6-9c25-0a52e658eca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:a0:1b', 'vm-uuid': '56967036-c176-4423-aa3e-c78ee4e364ac'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: INFO os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a0:1b,bridge_name='br-int',has_traffic_filtering=True,id=d6821969-0f10-4fd6-9c25-0a52e658eca6,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6821969-0f')
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:7f,bridge_name='br-int',has_traffic_filtering=True,id=3bfcc6b7-6768-47b7-ae40-f951761442a5,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfcc6b7-67') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:7f,bridge_name='br-int',has_traffic_filtering=True,id=3bfcc6b7-6768-47b7-ae40-f951761442a5,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfcc6b7-67') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bfcc6b7-67, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bfcc6b7-67, col_values=(('external_ids', {'iface-id': '3bfcc6b7-6768-47b7-ae40-f951761442a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:3f:7f', 'vm-uuid': '56967036-c176-4423-aa3e-c78ee4e364ac'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: INFO os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:7f,bridge_name='br-int',has_traffic_filtering=True,id=3bfcc6b7-6768-47b7-ae40-f951761442a5,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfcc6b7-67')
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=2f7a292d-75de-404e-bb4c-93e2bc9d190b,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7a292d-75') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=2f7a292d-75de-404e-bb4c-93e2bc9d190b,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7a292d-75') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f7a292d-75, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f7a292d-75, col_values=(('external_ids', {'iface-id': '2f7a292d-75de-404e-bb4c-93e2bc9d190b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:6e:45', 'vm-uuid': '56967036-c176-4423-aa3e-c78ee4e364ac'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: INFO os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=2f7a292d-75de-404e-bb4c-93e2bc9d190b,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7a292d-75')
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f5:b1,bridge_name='br-int',has_traffic_filtering=True,id=e060de39-0ed8-4aa3-9046-222f9254ddfe,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060de39-0e') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f5:b1,bridge_name='br-int',has_traffic_filtering=True,id=e060de39-0ed8-4aa3-9046-222f9254ddfe,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060de39-0e') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape060de39-0e, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape060de39-0e, col_values=(('external_ids', {'iface-id': 'e060de39-0ed8-4aa3-9046-222f9254ddfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:f5:b1', 'vm-uuid': '56967036-c176-4423-aa3e-c78ee4e364ac'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:42 user nova-compute[71347]: INFO os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f5:b1,bridge_name='br-int',has_traffic_filtering=True,id=e060de39-0ed8-4aa3-9046-222f9254ddfe,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060de39-0e')
Apr 14 14:18:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:e0,bridge_name='br-int',has_traffic_filtering=True,id=7923b754-a636-4e91-b166-ce9b0c0fce99,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7923b754-a6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:e0,bridge_name='br-int',has_traffic_filtering=True,id=7923b754-a636-4e91-b166-ce9b0c0fce99,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7923b754-a6') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7923b754-a6, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7923b754-a6, col_values=(('external_ids', {'iface-id': '7923b754-a636-4e91-b166-ce9b0c0fce99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:ca:e0', 'vm-uuid': '56967036-c176-4423-aa3e-c78ee4e364ac'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:42 user nova-compute[71347]: INFO os_vif [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:e0,bridge_name='br-int',has_traffic_filtering=True,id=7923b754-a636-4e91-b166-ce9b0c0fce99,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7923b754-a6')
Apr 14 14:18:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] No BDM found with device name hda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] No VIF found with MAC fa:16:3e:51:c9:1a, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] No VIF found with MAC fa:16:3e:46:6e:45, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:18:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Using config drive
Apr 14 14:18:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Creating config drive at /opt/stack/data/nova/instances/56967036-c176-4423-aa3e-c78ee4e364ac/disk.config
Apr 14 14:18:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/56967036-c176-4423-aa3e-c78ee4e364ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3_550vfv {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/56967036-c176-4423-aa3e-c78ee4e364ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3_550vfv" returned: 0 in 0.052s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:44 user nova-compute[71347]: WARNING nova.compute.manager [req-f2e56c9d-6ab6-4e01-8d54-638cd93172c9 req-823c919d-2edb-4caa-8ec7-9f4f7ca67bc5 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance with vm_state building and task_state spawning.
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:44 user nova-compute[71347]: WARNING nova.compute.manager [req-98837d40-d729-4fcd-b201-3c18c23c5549 req-0a646fcf-abc4-4989-a133-463c84e0b386 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance with vm_state building and task_state spawning.
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:45 user nova-compute[71347]: WARNING nova.compute.manager [req-0b59bd62-c3d9-48c7-afb7-ae3de570ce17 req-9c25adff-dbd0-440c-8629-043a54517efa service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe for instance with vm_state building and task_state spawning.
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance with vm_state building and task_state spawning.
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance with vm_state building and task_state spawning.
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance with vm_state building and task_state spawning.
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance with vm_state building and task_state spawning.
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance with vm_state building and task_state spawning.
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-9e378b0c-c8b8-43dc-a5f2-3e027c4df05b req-f03d5aa1-65aa-4bc0-9d22-639b11402be7 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 for instance with vm_state building and task_state spawning.
Apr 14 14:18:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance with vm_state building and task_state spawning.
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance with vm_state building and task_state spawning.
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:46 user nova-compute[71347]: WARNING nova.compute.manager [req-b2b90e16-fbd8-4dca-8dd9-b39e446bddc7 req-1788ebcf-34cb-4791-ad29-e834a8ef5593 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance with vm_state building and task_state spawning.
Apr 14 14:18:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:48 user nova-compute[71347]: WARNING nova.compute.manager [req-5d04ec87-f83a-4d71-998a-9d17135ee0cc req-c0e9dcee-3726-42c9-ba5a-11ec31fa2bd5 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe for instance with vm_state building and task_state spawning.
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481928.2304285, 56967036-c176-4423-aa3e-c78ee4e364ac => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:18:48 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] VM Resumed (Lifecycle Event)
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:18:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance spawned successfully.
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:18:48 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481928.2318013, 56967036-c176-4423-aa3e-c78ee4e364ac => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:18:48 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] VM Started (Lifecycle Event)
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:48 user nova-compute[71347]: WARNING nova.compute.manager [req-8ae8378b-6e38-43b7-a61c-4db67c02ab63 req-9e9ce74b-318e-4a5a-a904-acff6fc0ed0e service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 for instance with vm_state building and task_state spawning.
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:18:48 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:18:48 user nova-compute[71347]: INFO nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Took 10.90 seconds to spawn the instance on the hypervisor.
Apr 14 14:18:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:18:48 user nova-compute[71347]: INFO nova.compute.manager [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Took 29.08 seconds to build instance.
Apr 14 14:18:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d09e680b-8325-4422-8294-90f5cae5b9c7 tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "56967036-c176-4423-aa3e-c78ee4e364ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.192s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:50 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:18:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:50 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:52 user nova-compute[71347]: INFO nova.compute.manager [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Rescuing
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquired lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updating instance_info_cache with network_info: [{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Releasing lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-unplugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] No waiting events found dispatching network-vif-unplugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:53 user nova-compute[71347]: WARNING nova.compute.manager [req-a5ab2133-5a5f-42bb-bf49-6299ab2023c6 req-5625564c-86e1-4716-8016-a694edfa40b1 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received unexpected event network-vif-unplugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance with vm_state active and task_state rescuing.
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Instance destroyed successfully.
Apr 14 14:18:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Attempting rescue
Apr 14 14:18:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71347) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Instance directory exists: not creating {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 14:18:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Creating image(s)
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG nova.objects.instance [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.261s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue" returned: 0 in 0.054s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'migration_context' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Start _get_guest_xml network_info=[{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:df:88:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'resources' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:18:54 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:18:54 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1496827',display_name='tempest-ServerRescueNegativeTestJSON-server-1496827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1496827',id=2,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-kgeq8ou2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:17Z,user_data=None,user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=7c7956b5-905e-4a1a-b657-fe3aa5018258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:df:88:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:df:88:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:88:c6,bridge_name='br-int',has_traffic_filtering=True,id=9c5ceb2e-307c-4e1c-9356-b14b40e04290,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ceb2e-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:18:54 user nova-compute[71347]:   <uuid>7c7956b5-905e-4a1a-b657-fe3aa5018258</uuid>
Apr 14 14:18:54 user nova-compute[71347]:   <name>instance-00000002</name>
Apr 14 14:18:54 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:18:54 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:18:54 user nova-compute[71347]:   <metadata>
Apr 14 14:18:54 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:18:54 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:18:54 user nova-compute[71347]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1496827</nova:name>
Apr 14 14:18:54 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:18:54</nova:creationTime>
Apr 14 14:18:54 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:18:54 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:18:54 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:18:54 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:18:54 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:18:54 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:18:54 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:18:54 user nova-compute[71347]:       <nova:owner>
Apr 14 14:18:54 user nova-compute[71347]:         <nova:user uuid="cdfcb787b0f545f8b19e947d54d07b9c">tempest-ServerRescueNegativeTestJSON-1435712120-project-member</nova:user>
Apr 14 14:18:54 user nova-compute[71347]:         <nova:project uuid="b53efd997e3e47d898264dae8a27a5ad">tempest-ServerRescueNegativeTestJSON-1435712120</nova:project>
Apr 14 14:18:54 user nova-compute[71347]:       </nova:owner>
Apr 14 14:18:54 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:18:54 user nova-compute[71347]:       <nova:ports>
Apr 14 14:18:54 user nova-compute[71347]:         <nova:port uuid="9c5ceb2e-307c-4e1c-9356-b14b40e04290">
Apr 14 14:18:54 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 14:18:54 user nova-compute[71347]:         </nova:port>
Apr 14 14:18:54 user nova-compute[71347]:       </nova:ports>
Apr 14 14:18:54 user nova-compute[71347]:     </nova:instance>
Apr 14 14:18:54 user nova-compute[71347]:   </metadata>
Apr 14 14:18:54 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:18:54 user nova-compute[71347]:     <system>
Apr 14 14:18:54 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:18:54 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:18:54 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:18:54 user nova-compute[71347]:       <entry name="serial">7c7956b5-905e-4a1a-b657-fe3aa5018258</entry>
Apr 14 14:18:54 user nova-compute[71347]:       <entry name="uuid">7c7956b5-905e-4a1a-b657-fe3aa5018258</entry>
Apr 14 14:18:54 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:18:54 user nova-compute[71347]:     </system>
Apr 14 14:18:54 user nova-compute[71347]:   </sysinfo>
Apr 14 14:18:54 user nova-compute[71347]:   <os>
Apr 14 14:18:54 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:18:54 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:18:54 user nova-compute[71347]:   </os>
Apr 14 14:18:54 user nova-compute[71347]:   <features>
Apr 14 14:18:54 user nova-compute[71347]:     <acpi/>
Apr 14 14:18:54 user nova-compute[71347]:     <apic/>
Apr 14 14:18:54 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:18:54 user nova-compute[71347]:   </features>
Apr 14 14:18:54 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:18:54 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:18:54 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:18:54 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:18:54 user nova-compute[71347]:   </clock>
Apr 14 14:18:54 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:18:54 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:18:54 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:18:54 user nova-compute[71347]:   </cpu>
Apr 14 14:18:54 user nova-compute[71347]:   <devices>
Apr 14 14:18:54 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:18:54 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:18:54 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue"/>
Apr 14 14:18:54 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:18:54 user nova-compute[71347]:     </disk>
Apr 14 14:18:54 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:18:54 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:18:54 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk"/>
Apr 14 14:18:54 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:18:54 user nova-compute[71347]:     </disk>
Apr 14 14:18:54 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:18:54 user nova-compute[71347]:       <mac address="fa:16:3e:df:88:c6"/>
Apr 14 14:18:54 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:54 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:18:54 user nova-compute[71347]:       <target dev="tap9c5ceb2e-30"/>
Apr 14 14:18:54 user nova-compute[71347]:     </interface>
Apr 14 14:18:54 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:18:54 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/console.log" append="off"/>
Apr 14 14:18:54 user nova-compute[71347]:     </serial>
Apr 14 14:18:54 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:18:54 user nova-compute[71347]:     <video>
Apr 14 14:18:54 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:18:54 user nova-compute[71347]:     </video>
Apr 14 14:18:54 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:18:54 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:18:54 user nova-compute[71347]:     </rng>
Apr 14 14:18:54 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:18:54 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:18:54 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:18:54 user nova-compute[71347]:     </memballoon>
Apr 14 14:18:54 user nova-compute[71347]:   </devices>
Apr 14 14:18:54 user nova-compute[71347]: </domain>
Apr 14 14:18:54 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:18:54 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Instance destroyed successfully.
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No VIF found with MAC fa:16:3e:df:88:c6, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:18:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 7c7956b5-905e-4a1a-b657-fe3aa5018258 due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481938.4259276, 7c7956b5-905e-4a1a-b657-fe3aa5018258 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:18:58 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] VM Resumed (Lifecycle Event)
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] No waiting events found dispatching network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:58 user nova-compute[71347]: WARNING nova.compute.manager [req-3d18acfb-0d5a-4a52-a46b-7ea2452604f7 req-b0e46223-f290-472e-8279-e33d62b5f320 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received unexpected event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance with vm_state active and task_state rescuing.
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] No waiting events found dispatching network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:58 user nova-compute[71347]: WARNING nova.compute.manager [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received unexpected event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance with vm_state active and task_state rescuing.
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] No waiting events found dispatching network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:18:58 user nova-compute[71347]: WARNING nova.compute.manager [req-139231e4-463a-4e00-8e29-0fd512622654 req-53e8276f-7248-4e26-874b-5e2d91987daf service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received unexpected event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance with vm_state active and task_state rescuing.
Apr 14 14:18:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-90cc2c94-75b2-4eed-af75-92fcf587de22 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:18:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:18:59 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:18:59 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7140MB free_disk=26.697647094726562GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:18:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481938.4266768, 7c7956b5-905e-4a1a-b657-fe3aa5018258 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:18:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] VM Started (Lifecycle Event)
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56967036-c176-4423-aa3e-c78ee4e364ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 06baebb6-4922-4d82-b396-48bf76c60f2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance bc70d475-20dd-4859-a6fe-d2d09341799e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e81e92d6-b79e-46db-b69e-1f7584440287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:18:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.789s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "f40364b4-9668-45e3-8d72-d6e49ebb0147" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:19:00 user nova-compute[71347]: INFO nova.compute.claims [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Claim successful on node user
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:00 user nova-compute[71347]: INFO nova.compute.manager [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Terminating instance
Apr 14 14:19:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.119s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received event network-vif-unplugged-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] Acquiring lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] No waiting events found dispatching network-vif-unplugged-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-36c0200b-ab16-4ade-bf10-476b59f55919 req-5d525724-27a9-4ffa-9367-1c1d4922d1fd service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received event network-vif-unplugged-03114745-3adc-4f7e-b3e5-6623abee6e40 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.network.neutron [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:19:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:19:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Instance destroyed successfully.
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.objects.instance [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lazy-loading 'resources' on Instance uuid 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.policy [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a609ae82102a4ec994823e59f1a37378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08dbbd3691924823b98d44b11508019e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1210991027',display_name='tempest-VolumesActionsTest-instance-1210991027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1210991027',id=3,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e71e69f67a4c44be53fa655a7b50e5',ramdisk_id='',reservation_id='r-e9m60xri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1835732015',owner_user_name='tempest-VolumesActionsTest-1835732015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:20Z,user_data=None,user_id='f6a767acbdff4f65bef46f45d0c745f7',uuid=6ff5dcc6-7fcf-4785-88dd-f3104832a2b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Converting VIF {"id": "03114745-3adc-4f7e-b3e5-6623abee6e40", "address": "fa:16:3e:c0:2b:05", "network": {"id": "47bbc824-8196-42ee-a900-6160879c338b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-465266891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b3e71e69f67a4c44be53fa655a7b50e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03114745-3a", "ovs_interfaceid": "03114745-3adc-4f7e-b3e5-6623abee6e40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=03114745-3adc-4f7e-b3e5-6623abee6e40,network=Network(47bbc824-8196-42ee-a900-6160879c338b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03114745-3a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG os_vif [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=03114745-3adc-4f7e-b3e5-6623abee6e40,network=Network(47bbc824-8196-42ee-a900-6160879c338b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03114745-3a') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03114745-3a, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:19:01 user nova-compute[71347]: INFO os_vif [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2b:05,bridge_name='br-int',has_traffic_filtering=True,id=03114745-3adc-4f7e-b3e5-6623abee6e40,network=Network(47bbc824-8196-42ee-a900-6160879c338b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03114745-3a')
Apr 14 14:19:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Deleting instance files /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4_del
Apr 14 14:19:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Deletion of /opt/stack/data/nova/instances/6ff5dcc6-7fcf-4785-88dd-f3104832a2b4_del complete
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71347) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 14:19:01 user nova-compute[71347]: INFO nova.virt.libvirt.host [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] UEFI support detected
Apr 14 14:19:01 user nova-compute[71347]: INFO nova.compute.manager [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Took 0.82 seconds to destroy the instance on the hypervisor.
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:19:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Creating image(s)
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "/opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "/opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "/opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.166s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updating instance_info_cache with network_info: [{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.193s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk 1073741824" returned: 0 in 0.054s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.158s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.network.neutron [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Successfully created port: dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Cannot resize image /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lazy-loading 'migration_context' on Instance uuid f40364b4-9668-45e3-8d72-d6e49ebb0147 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Ensure instance console log exists: /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:02 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Took 0.99 seconds to deallocate network for instance.
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received event network-vif-deleted-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:02 user nova-compute[71347]: INFO nova.compute.manager [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Neutron deleted interface 03114745-3adc-4f7e-b3e5-6623abee6e40; detaching it from the instance and deleting it from the info cache
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.network.neutron [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-059c8820-34b9-4612-a9c2-cefbeb8b3f24 req-a5cd2265-435a-470c-801a-bab0536c87cc service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Detach interface failed, port_id=03114745-3adc-4f7e-b3e5-6623abee6e40, reason: Instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:03 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:19:03 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:19:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received event network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] Acquiring lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] No waiting events found dispatching network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:03 user nova-compute[71347]: WARNING nova.compute.manager [req-1bc20d43-c12a-4114-a2e1-a8912e52f7bc req-6dfeb467-90bb-480b-a4f2-f861cd5119da service nova] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Received unexpected event network-vif-plugged-03114745-3adc-4f7e-b3e5-6623abee6e40 for instance with vm_state deleted and task_state None.
Apr 14 14:19:03 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Deleted allocations for instance 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4
Apr 14 14:19:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8603f220-0234-4a31-ae1a-2f46cc0b2f45 tempest-VolumesActionsTest-1835732015 tempest-VolumesActionsTest-1835732015-project-member] Lock "6ff5dcc6-7fcf-4785-88dd-f3104832a2b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.820s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Successfully updated port: dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "refresh_cache-f40364b4-9668-45e3-8d72-d6e49ebb0147" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquired lock "refresh_cache-f40364b4-9668-45e3-8d72-d6e49ebb0147" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received event network-changed-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Refreshing instance network info cache due to event network-changed-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] Acquiring lock "refresh_cache-f40364b4-9668-45e3-8d72-d6e49ebb0147" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Updating instance_info_cache with network_info: [{"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Releasing lock "refresh_cache-f40364b4-9668-45e3-8d72-d6e49ebb0147" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Instance network_info: |[{"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] Acquired lock "refresh_cache-f40364b4-9668-45e3-8d72-d6e49ebb0147" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.neutron [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Refreshing network info cache for port dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Start _get_guest_xml network_info=[{"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:19:04 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:19:04 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1371872177',display_name='tempest-ServersNegativeTestJSON-server-1371872177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1371872177',id=13,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08dbbd3691924823b98d44b11508019e',ramdisk_id='',reservation_id='r-lhx2dy9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1373448962',owner_user_name='tempest-ServersNegativeTestJSON-1373448962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:19:02Z,user_data=None,user_id='a609ae82102a4ec994823e59f1a37378',uuid=f40364b4-9668-45e3-8d72-d6e49ebb0147,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converting VIF {"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=dc8cdaa4-b172-48b6-8678-a9d4f56e2af8,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8cdaa4-b1') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lazy-loading 'pci_devices' on Instance uuid f40364b4-9668-45e3-8d72-d6e49ebb0147 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:19:04 user nova-compute[71347]:   <uuid>f40364b4-9668-45e3-8d72-d6e49ebb0147</uuid>
Apr 14 14:19:04 user nova-compute[71347]:   <name>instance-0000000d</name>
Apr 14 14:19:04 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:19:04 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:19:04 user nova-compute[71347]:   <metadata>
Apr 14 14:19:04 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:19:04 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:19:04 user nova-compute[71347]:       <nova:name>tempest-ServersNegativeTestJSON-server-1371872177</nova:name>
Apr 14 14:19:04 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:19:04</nova:creationTime>
Apr 14 14:19:04 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:19:04 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:19:04 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:19:04 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:19:04 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:19:04 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:19:04 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:19:04 user nova-compute[71347]:       <nova:owner>
Apr 14 14:19:04 user nova-compute[71347]:         <nova:user uuid="a609ae82102a4ec994823e59f1a37378">tempest-ServersNegativeTestJSON-1373448962-project-member</nova:user>
Apr 14 14:19:04 user nova-compute[71347]:         <nova:project uuid="08dbbd3691924823b98d44b11508019e">tempest-ServersNegativeTestJSON-1373448962</nova:project>
Apr 14 14:19:04 user nova-compute[71347]:       </nova:owner>
Apr 14 14:19:04 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:19:04 user nova-compute[71347]:       <nova:ports>
Apr 14 14:19:04 user nova-compute[71347]:         <nova:port uuid="dc8cdaa4-b172-48b6-8678-a9d4f56e2af8">
Apr 14 14:19:04 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 14:19:04 user nova-compute[71347]:         </nova:port>
Apr 14 14:19:04 user nova-compute[71347]:       </nova:ports>
Apr 14 14:19:04 user nova-compute[71347]:     </nova:instance>
Apr 14 14:19:04 user nova-compute[71347]:   </metadata>
Apr 14 14:19:04 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:19:04 user nova-compute[71347]:     <system>
Apr 14 14:19:04 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:19:04 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:19:04 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:19:04 user nova-compute[71347]:       <entry name="serial">f40364b4-9668-45e3-8d72-d6e49ebb0147</entry>
Apr 14 14:19:04 user nova-compute[71347]:       <entry name="uuid">f40364b4-9668-45e3-8d72-d6e49ebb0147</entry>
Apr 14 14:19:04 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:19:04 user nova-compute[71347]:     </system>
Apr 14 14:19:04 user nova-compute[71347]:   </sysinfo>
Apr 14 14:19:04 user nova-compute[71347]:   <os>
Apr 14 14:19:04 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:19:04 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:19:04 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:19:04 user nova-compute[71347]:   </os>
Apr 14 14:19:04 user nova-compute[71347]:   <features>
Apr 14 14:19:04 user nova-compute[71347]:     <acpi/>
Apr 14 14:19:04 user nova-compute[71347]:     <apic/>
Apr 14 14:19:04 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:19:04 user nova-compute[71347]:   </features>
Apr 14 14:19:04 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:19:04 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:19:04 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:19:04 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:19:04 user nova-compute[71347]:   </clock>
Apr 14 14:19:04 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:19:04 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:19:04 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:19:04 user nova-compute[71347]:   </cpu>
Apr 14 14:19:04 user nova-compute[71347]:   <devices>
Apr 14 14:19:04 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:19:04 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:19:04 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk"/>
Apr 14 14:19:04 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:19:04 user nova-compute[71347]:     </disk>
Apr 14 14:19:04 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:19:04 user nova-compute[71347]:       <mac address="fa:16:3e:b1:f2:5e"/>
Apr 14 14:19:04 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:19:04 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:19:04 user nova-compute[71347]:       <target dev="tapdc8cdaa4-b1"/>
Apr 14 14:19:04 user nova-compute[71347]:     </interface>
Apr 14 14:19:04 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:19:04 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/console.log" append="off"/>
Apr 14 14:19:04 user nova-compute[71347]:     </serial>
Apr 14 14:19:04 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:19:04 user nova-compute[71347]:     <video>
Apr 14 14:19:04 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:19:04 user nova-compute[71347]:     </video>
Apr 14 14:19:04 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:19:04 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:19:04 user nova-compute[71347]:     </rng>
Apr 14 14:19:04 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:19:04 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:19:04 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:19:04 user nova-compute[71347]:     </memballoon>
Apr 14 14:19:04 user nova-compute[71347]:   </devices>
Apr 14 14:19:04 user nova-compute[71347]: </domain>
Apr 14 14:19:04 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1371872177',display_name='tempest-ServersNegativeTestJSON-server-1371872177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1371872177',id=13,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08dbbd3691924823b98d44b11508019e',ramdisk_id='',reservation_id='r-lhx2dy9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1373448962',owner_user_name='tempest-ServersNegativeTestJSON-1373448962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:19:02Z,user_data=None,user_id='a609ae82102a4ec994823e59f1a37378',uuid=f40364b4-9668-45e3-8d72-d6e49ebb0147,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converting VIF {"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=dc8cdaa4-b172-48b6-8678-a9d4f56e2af8,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8cdaa4-b1') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG os_vif [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=dc8cdaa4-b172-48b6-8678-a9d4f56e2af8,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8cdaa4-b1') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc8cdaa4-b1, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc8cdaa4-b1, col_values=(('external_ids', {'iface-id': 'dc8cdaa4-b172-48b6-8678-a9d4f56e2af8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:f2:5e', 'vm-uuid': 'f40364b4-9668-45e3-8d72-d6e49ebb0147'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:04 user nova-compute[71347]: INFO os_vif [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=dc8cdaa4-b172-48b6-8678-a9d4f56e2af8,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8cdaa4-b1')
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] No VIF found with MAC fa:16:3e:b1:f2:5e, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:19:05 user nova-compute[71347]: DEBUG nova.network.neutron [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Updated VIF entry in instance network info cache for port dc8cdaa4-b172-48b6-8678-a9d4f56e2af8. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:05 user nova-compute[71347]: DEBUG nova.network.neutron [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Updating instance_info_cache with network_info: [{"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a2cc54ee-7ad6-44df-a2fa-34eea508361a req-8fe1a1dc-bed1-4b54-afa8-da61bddeff72 service nova] Releasing lock "refresh_cache-f40364b4-9668-45e3-8d72-d6e49ebb0147" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-changed-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Refreshing instance network info cache due to event network-changed-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:05 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Refreshing network info cache for port 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updated VIF entry in instance network info cache for port 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received event network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] Acquiring lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] No waiting events found dispatching network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:06 user nova-compute[71347]: WARNING nova.compute.manager [req-45114732-eec3-406e-b816-2f98d805af06 req-4fb2d805-a9dc-41e5-b5bf-aa296d906066 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received unexpected event network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance with vm_state building and task_state spawning.
Apr 14 14:19:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0c07433-c527-4b63-ac04-0114f1b9ad80 req-46ff1be5-19c6-4c61-b3bc-d78576848c0e service nova] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481948.283936, f40364b4-9668-45e3-8d72-d6e49ebb0147 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:19:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] VM Resumed (Lifecycle Event)
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:19:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Instance spawned successfully.
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:19:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681481948.2852626, f40364b4-9668-45e3-8d72-d6e49ebb0147 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:19:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] VM Started (Lifecycle Event)
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:19:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:19:08 user nova-compute[71347]: INFO nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Took 6.68 seconds to spawn the instance on the hypervisor.
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received event network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] Acquiring lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] No waiting events found dispatching network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:08 user nova-compute[71347]: WARNING nova.compute.manager [req-904a6676-74dc-49c9-9637-050a27a50001 req-5e1c2620-edad-45fb-9c33-9e5e17045ec1 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received unexpected event network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance with vm_state building and task_state spawning.
Apr 14 14:19:08 user nova-compute[71347]: INFO nova.compute.manager [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Took 8.36 seconds to build instance.
Apr 14 14:19:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-67729183-8278-468e-9f60-3ad455ebad80 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.506s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lazy-loading 'flavor' on Instance uuid 06baebb6-4922-4d82-b396-48bf76c60f2d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:10 user nova-compute[71347]: INFO nova.compute.manager [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Attaching volume cdf0ef7a-ce14-4a26-8aba-068a1326d8fa to /dev/vdb
Apr 14 14:19:10 user nova-compute[71347]: DEBUG os_brick.utils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[178afdac-8e26-4d8f-a680-4a6313df7c23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2e023a-3a6f-46e7-98fc-b3755c52156c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe3e66f-59b0-4595-b048-ecfe9c0e75ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0072eafd-d650-42f5-a88e-7aac841b6e3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:10 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:19:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b79557d-11b1-4be8-90b9-d32afa69da84]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG os_brick.utils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:10 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Updating existing volume attachment record: 1dc0c591-da89-4f54-aa9d-c5cfdefdf8f6 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:19:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-changed-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Refreshing instance network info cache due to event network-changed-839834af-8da2-4f1a-84c5-e0469c3679f5. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] Acquiring lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] Acquired lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Refreshing network info cache for port 839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:16 user nova-compute[71347]: DEBUG nova.network.neutron [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updated VIF entry in instance network info cache for port 839834af-8da2-4f1a-84c5-e0469c3679f5. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:16 user nova-compute[71347]: DEBUG nova.network.neutron [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a1ceef4-ac59-429c-89c0-b00783d8ff8f req-9321f4cb-224f-4177-b7d7-4490b7d51f0f service nova] Releasing lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:16 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681481941.6715593, 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:19:16 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] VM Stopped (Lifecycle Event)
Apr 14 14:19:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f6f80dc9-64eb-4de1-bf9a-bbeb507af6b1 None None] [instance: 6ff5dcc6-7fcf-4785-88dd-f3104832a2b4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:19:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHyEaICQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:18 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:18 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:18 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[52628d20-debc-4342-b7a8-e7998d175f02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:19:18 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66d90f-856a-432e-80de-03903b058795]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa] added
Apr 14 14:19:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1627208e-2f82-485c-ac24-a29df61267c7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d831a2-b19c-43a1-b5a5-0c65622a0e17]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHyEaICQ {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHyEaICQ" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffc7cfa-069d-496d-8eab-f0d188ea9ac9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZHyEaICQ'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07ba25a-290d-4112-bc90-be550e18c3fd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a4e733-2954-46a3-9971-0606e43bf050]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:18 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:18 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:18 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:18 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f66bc5a-5a54-4e1a-aee5-0ce8df85a4cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa, portal: 172.16.0.220,3260]
Apr 14 14:19:19 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:19 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626c67f-b062-48de-8c80-cea89dcfb43c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d730099-bd4d-4182-9bfb-16891c864896]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:19 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:19 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:19 user nova-compute[71347]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa (non-flash)
Apr 14 14:19:19 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:19 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:19 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:19 user nova-compute[71347]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa (non-flash)
Apr 14 14:19:19 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d2205f-a161-4776-a8a7-ba6e3e8a4fc5]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHyEaICQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:19 user nova-compute[71347]: INFO nova.compute.manager [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Shelving
Apr 14 14:19:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-unplugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] No waiting events found dispatching network-vif-unplugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:19 user nova-compute[71347]: WARNING nova.compute.manager [req-943b2f3b-58f1-4af4-a183-b090a8b4a63e req-085c447d-b965-4aaf-a0eb-f13842a12aa6 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received unexpected event network-vif-unplugged-839834af-8da2-4f1a-84c5-e0469c3679f5 for instance with vm_state active and task_state shelving.
Apr 14 14:19:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:20 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance destroyed successfully.
Apr 14 14:19:20 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Beginning cold snapshot process
Apr 14 14:19:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23032393530653161', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032393530653161', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lazy-loading 'flavor' on Instance uuid 06baebb6-4922-4d82-b396-48bf76c60f2d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:19:20 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:20 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:20 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:19:20 user nova-compute[71347]:   <serial>cdf0ef7a-ce14-4a26-8aba-068a1326d8fa</serial>
Apr 14 14:19:20 user nova-compute[71347]: </disk>
Apr 14 14:19:20 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk /opt/stack/data/nova/instances/snapshots/tmpfi1et3f5/9beee7055fa5404f8f0860e998755bc9 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] No VIF found with MAC fa:16:3e:63:a6:48, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:19:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk /opt/stack/data/nova/instances/snapshots/tmpfi1et3f5/9beee7055fa5404f8f0860e998755bc9" returned: 0 in 0.411s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:20 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Snapshot extracted, beginning image upload
Apr 14 14:19:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fa5083c7-2ea5-4347-870c-af5ede1e7776 tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.508s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:21 user nova-compute[71347]: INFO nova.compute.manager [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Terminating instance
Apr 14 14:19:21 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received event network-vif-unplugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] No waiting events found dispatching network-vif-unplugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-d19b2b20-6cee-44ba-85b9-b4e7e3aac699 req-1e8c3beb-d009-4d0a-9215-6f638fe36bee service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received event network-vif-unplugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] No waiting events found dispatching network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:21 user nova-compute[71347]: WARNING nova.compute.manager [req-46c6b432-1d3d-4990-b3b0-8ad122f6a5c3 req-f2d684b0-af8b-42c4-ae25-cf67817d9e84 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received unexpected event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 14:19:22 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Instance destroyed successfully.
Apr 14 14:19:22 user nova-compute[71347]: DEBUG nova.objects.instance [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lazy-loading 'resources' on Instance uuid 06baebb6-4922-4d82-b396-48bf76c60f2d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1709371088',display_name='tempest-DeleteServersTestJSON-server-1709371088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1709371088',id=6,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec387d0522a482998dc856bf579d1af',ramdisk_id='',reservation_id='r-fzzhwimx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2021198395',owner_user_name='tempest-DeleteServersTestJSON-2021198395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:34Z,user_data=None,user_id='43e27123c26e416a8d024d4029249f4b',uuid=06baebb6-4922-4d82-b396-48bf76c60f2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Converting VIF {"id": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "address": "fa:16:3e:63:a6:48", "network": {"id": "10c13d5f-fce7-4ec7-a3a3-82927a3d1185", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1721168349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec387d0522a482998dc856bf579d1af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec51781-92", "ovs_interfaceid": "1ec51781-92ba-45d2-9635-5aa1c6cf918a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:48,bridge_name='br-int',has_traffic_filtering=True,id=1ec51781-92ba-45d2-9635-5aa1c6cf918a,network=Network(10c13d5f-fce7-4ec7-a3a3-82927a3d1185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec51781-92') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_vif [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:48,bridge_name='br-int',has_traffic_filtering=True,id=1ec51781-92ba-45d2-9635-5aa1c6cf918a,network=Network(10c13d5f-fce7-4ec7-a3a3-82927a3d1185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec51781-92') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec51781-92, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:22 user nova-compute[71347]: INFO os_vif [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:a6:48,bridge_name='br-int',has_traffic_filtering=True,id=1ec51781-92ba-45d2-9635-5aa1c6cf918a,network=Network(10c13d5f-fce7-4ec7-a3a3-82927a3d1185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec51781-92')
Apr 14 14:19:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHyEaICQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:22 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc83cda-c640-4f70-bcbe-2e42c0003b56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:19:22 user nova-compute[71347]: No targets found.
Apr 14 14:19:22 user nova-compute[71347]: iSNS:
Apr 14 14:19:22 user nova-compute[71347]: No targets found.
Apr 14 14:19:22 user nova-compute[71347]: STATIC:
Apr 14 14:19:22 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa
Apr 14 14:19:22 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:22 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:22 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896
Apr 14 14:19:22 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:22 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:22 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:19:22 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:22 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:22 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:19:22 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:22 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:22 user nova-compute[71347]: FIRMWARE:
Apr 14 14:19:22 user nova-compute[71347]: No targets found.
Apr 14 14:19:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:19:22 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:19:22 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86c8267-f84b-4cca-84e6-6bf33d7eb9dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffac510-7efe-481e-8573-b72c1f6e5d68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:22 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:22 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:22 user nova-compute[71347]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa (non-flash)
Apr 14 14:19:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:22 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:22 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:22 user nova-compute[71347]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa (non-flash)
Apr 14 14:19:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50077af7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[719cc8c6-e2d8-41e0-83e4-d7a7c3f5a40c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a882c-2d80-4846-a923-41e4880e3a39]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cae9bb-6c8a-462b-a995-b3a73680dfa3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2302c57-ae10-4fe6-8c27-2e99d7273d15]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c512ae1-418e-4d68-91ba-c3c03b19884a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b590bc-9bd9-41ed-b017-ac22560a0691]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa, portal: 172.16.0.220,3260]
Apr 14 14:19:22 user nova-compute[71347]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdf0ef7a-ce14-4a26-8aba-068a1326d8fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8eb752-c009-4859-83bf-88ca2ef1ffc1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] <== disconnect_volume: return (313ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:19:22 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Deleting instance files /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d_del
Apr 14 14:19:22 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Deletion of /opt/stack/data/nova/instances/06baebb6-4922-4d82-b396-48bf76c60f2d_del complete
Apr 14 14:19:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:22 user nova-compute[71347]: INFO nova.compute.manager [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Took 1.31 seconds to destroy the instance on the hypervisor.
Apr 14 14:19:22 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:19:22 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:19:23 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Snapshot image upload complete
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:23 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Took 0.64 seconds to deallocate network for instance.
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received event network-vif-deleted-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:23 user nova-compute[71347]: INFO nova.compute.manager [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Neutron deleted interface 1ec51781-92ba-45d2-9635-5aa1c6cf918a; detaching it from the instance and deleting it from the info cache
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.network.neutron [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:23 user nova-compute[71347]: INFO nova.compute.manager [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Shelve offloading
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-fbc32fe0-9479-4185-89ec-44cc74ae9c35 req-2d4eec9b-e73e-4070-a01b-64e0566cc243 service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Detach interface failed, port_id=1ec51781-92ba-45d2-9635-5aa1c6cf918a, reason: Instance 06baebb6-4922-4d82-b396-48bf76c60f2d could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:19:23 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance destroyed successfully.
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquired lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received event network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] Acquiring lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] No waiting events found dispatching network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:23 user nova-compute[71347]: WARNING nova.compute.manager [req-8a6d24c1-a025-4927-aa1b-a48cbd4f0880 req-f678491f-d651-421a-804e-fd880d4bf3ea service nova] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Received unexpected event network-vif-plugged-1ec51781-92ba-45d2-9635-5aa1c6cf918a for instance with vm_state active and task_state deleting.
Apr 14 14:19:24 user nova-compute[71347]: INFO nova.compute.manager [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Took 0.95 seconds to detach 1 volumes for instance.
Apr 14 14:19:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:24 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Releasing lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:24 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:19:24 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:19:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:24 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Deleted allocations for instance 06baebb6-4922-4d82-b396-48bf76c60f2d
Apr 14 14:19:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a383ba51-bd33-4f16-8f1a-85d75b04232c tempest-DeleteServersTestJSON-2021198395 tempest-DeleteServersTestJSON-2021198395-project-member] Lock "06baebb6-4922-4d82-b396-48bf76c60f2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.600s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:25 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance destroyed successfully.
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'resources' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1743182580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1743182580',id=7,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtFgmxFsC73JI3EOJh01Vi6JhjHyCGpGBiOSuQtkbj5LzuB0w3biqviCjGuFN4y4RXRWYVOA71m7CX2sS0tv+XOQaF5SvRG09bebHIKCIKlHl28aGGTIvcDfXJMO71mjA==',key_name='tempest-keypair-394852903',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-im4193la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member',shelved_at='2023-04-14T14:19:23.260037',shelved_host='user',shelved_image_id='600bbe0a-7a39-4b51-907c-9612cab2c38e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=e81e92d6-b79e-46db-b69e-1f7584440287,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG os_vif [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap839834af-8d, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:25 user nova-compute[71347]: INFO os_vif [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d')
Apr 14 14:19:25 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Deleting instance files /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287_del
Apr 14 14:19:25 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Deletion of /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287_del complete
Apr 14 14:19:25 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Deleted allocations for instance e81e92d6-b79e-46db-b69e-1f7584440287
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-changed-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Refreshing instance network info cache due to event network-changed-839834af-8da2-4f1a-84c5-e0469c3679f5. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] Acquiring lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] Acquired lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.network.neutron [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Refreshing network info cache for port 839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'numa_topology' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ff6968ee-088b-4fbf-bb85-d9651965c2f8 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.579s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.network.neutron [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updated VIF entry in instance network info cache for port 839834af-8da2-4f1a-84c5-e0469c3679f5. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG nova.network.neutron [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap839834af-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-235ec64f-9a48-4230-a6e4-ac1614d6bb72 req-677b1300-0f06-4c9f-a683-bf3117310db0 service nova] Releasing lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received event network-changed-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Refreshing instance network info cache due to event network-changed-513e9086-658d-44df-962e-3a4f16649083. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] Acquiring lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] Acquired lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Refreshing network info cache for port 513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updated VIF entry in instance network info cache for port 513e9086-658d-44df-962e-3a4f16649083. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updating instance_info_cache with network_info: [{"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-18dc60e5-9cea-405e-a1e8-20559b71be4e req-7cf8abef-47c3-43c8-af44-8e5bc49b1be0 service nova] Releasing lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'flavor' on Instance uuid bc70d475-20dd-4859-a6fe-d2d09341799e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.186s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:31 user nova-compute[71347]: INFO nova.compute.manager [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Attaching volume 183777d6-8fe6-4b09-b33f-759cf148aac1 to /dev/vdb
Apr 14 14:19:31 user nova-compute[71347]: DEBUG os_brick.utils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb3e4fb-5e00-4e29-a200-b10ddf5fb7d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c31d72-ac49-422a-9bd8-56c2ffba13f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[55673d58-0244-4937-8597-54b7947a7abd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aa8bb9-9e8c-4fba-9dbb-059b69be9a6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:31 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:19:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6de8f3-332c-4006-b972-c5b05217e938]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG os_brick.utils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:31 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updating existing volume attachment record: f5f031af-90c2-4eb8-a559-1dfa1b801a11 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received event network-changed-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Refreshing instance network info cache due to event network-changed-53a43ee4-c532-49fb-b441-84020cd63e8a. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] Acquiring lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] Acquired lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG nova.network.neutron [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Refreshing network info cache for port 53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG nova.objects.instance [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lazy-loading 'flavor' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:32 user nova-compute[71347]: INFO nova.compute.manager [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Attaching volume 9c65a03b-5934-480a-9047-4182f7796fcd to /dev/vdb
Apr 14 14:19:32 user nova-compute[71347]: DEBUG os_brick.utils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd513407-3112-4c76-b901-681dbeeafffe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387cccf-244a-4f95-bf8d-c9e2ee8c3ad1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b89b9-8c47-4ab3-9d00-5bccaecec4e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[697437ec-2078-4a17-ad87-2288877ee6fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG nova.network.neutron [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Updated VIF entry in instance network info cache for port 53a43ee4-c532-49fb-b441-84020cd63e8a. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG nova.network.neutron [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Updating instance_info_cache with network_info: [{"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:32 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1075818b-006b-4cfe-b9b3-9474c69aa2f3]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG os_brick.utils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Updating existing volume attachment record: d5eb97df-b83c-44b3-857f-181969f82273 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6ee416a5-a35d-41e0-ba49-71c3f1186cf6 req-d07053ea-c131-4561-bcc1-0d8939676c54 service nova] Releasing lock "refresh_cache-4d417e09-6e54-4cad-91e5-7910ee4e784a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:35 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681481960.052075, e81e92d6-b79e-46db-b69e-1f7584440287 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:19:35 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] VM Stopped (Lifecycle Event)
Apr 14 14:19:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a8dd2aab-205e-44f3-9d0a-e7cff6416885 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:19:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcGKuZSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:36 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:36 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:36 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81c358f-442b-4182-9182-a0aadffea1ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:19:36 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8980891c-6114-4545-9341-4289eaa66c9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1] added
Apr 14 14:19:36 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19ebbdc-8693-48b1-bf2b-cc2e33e84f43]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea4c6dc-c482-4475-85a9-a1d1dfe14a82]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HcGKuZSv {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HcGKuZSv" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb7163-6049-4dc2-97d7-1f75406b0f99]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HcGKuZSv'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e7720-9317-403d-98c5-7070ebe27f0a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be0649d-283b-4aee-95a3-961ad2d2f759]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55d2082-3857-440b-be9d-0098c7b8561f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1, portal: 172.16.0.220,3260]
Apr 14 14:19:37 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46086b2-201c-456f-808c-8c73d51a5eb6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received event network-changed-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Refreshing instance network info cache due to event network-changed-45351ca7-0534-4a7c-806b-71b0412f4e5d. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] Acquiring lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] Acquired lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG nova.network.neutron [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Refreshing network info cache for port 45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1723295f-9250-4a21-9656-f2b00b55ad3c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681481962.146021, 06baebb6-4922-4d82-b396-48bf76c60f2d => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:19:37 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] VM Stopped (Lifecycle Event)
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)
Apr 14 14:19:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7cb0da0c-94c4-487a-a9b8-8e60c481c573 None None] [instance: 06baebb6-4922-4d82-b396-48bf76c60f2d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d847c7ab-fe28-4173-9948-7eb6f9e6df9d]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:37 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG nova.network.neutron [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Updated VIF entry in instance network info cache for port 45351ca7-0534-4a7c-806b-71b0412f4e5d. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG nova.network.neutron [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Updating instance_info_cache with network_info: [{"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7155e129-303a-4beb-9976-671392a54c46 req-b1924565-102c-4aa7-bd80-1c80ff56ab45 service nova] Releasing lock "refresh_cache-14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcGKuZSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26439343061316431', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439343061316431', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.474s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:38 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:38 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'flavor' on Instance uuid bc70d475-20dd-4859-a6fe-d2d09341799e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a154e7-1ab2-446f-b88b-d7716d27c8ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:19:38 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:19:38 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:38 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:38 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:19:38 user nova-compute[71347]:   <serial>183777d6-8fe6-4b09-b33f-759cf148aac1</serial>
Apr 14 14:19:38 user nova-compute[71347]: </disk>
Apr 14 14:19:38 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[690bfa2e-3cfa-4da9-988b-80bb5ff8b847]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd] added
Apr 14 14:19:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[56846102-cab7-4d90-bdac-001e944b4d5f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c33251d-116f-4c95-b005-2aef3d3a4882]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJlhdKMn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJlhdKMn" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[47628b72-f520-48bc-a3a4-bd1b205b1122]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WJlhdKMn'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f71804-9c15-4ff4-b416-6ad086b2f9ce]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4166f9a8-d924-4a88-a578-328d05cd7e52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d834c-52c7-405c-a374-f8564e31b93b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260]
Apr 14 14:19:38 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e950eab6-da50-4225-9d6b-1065c4dcce3f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2cc84e-cf93-40d6-93b8-52d80b70660e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)
Apr 14 14:19:38 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36949ff-1272-4833-baa8-d04416804246]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] No VIF found with MAC fa:16:3e:3e:41:4f, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-changed-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Refreshing instance network info cache due to event network-changed-93ca09be-6bf7-49fb-873a-b3236618a784. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] Acquiring lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] Acquired lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Refreshing network info cache for port 93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e742fe04-e631-4fd2-b90e-f3328bf7ab85 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.353s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "interface-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "interface-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'flavor' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updated VIF entry in instance network info cache for port 93ca09be-6bf7-49fb-873a-b3236618a784. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating instance_info_cache with network_info: [{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45c077f4-f2e3-4bc9-a98f-2d0c0e9ea8df req-17be7761-2add-4ca6-893e-851184da4547 service nova] Releasing lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'pci_requests' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] <== connect_volume: return (1839ms) {'type': 'block', 'scsi_wwn': '23063326133393632', 'path': '/dev/sdf'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063326133393632', 'path': '/dev/sdf'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.objects.instance [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lazy-loading 'flavor' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:19:39 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:39 user nova-compute[71347]:   <source dev="/dev/sdf"/>
Apr 14 14:19:39 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:19:39 user nova-compute[71347]:   <serial>9c65a03b-5934-480a-9047-4182f7796fcd</serial>
Apr 14 14:19:39 user nova-compute[71347]: </disk>
Apr 14 14:19:39 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.policy [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec166aaa170041c1a486379c7f417e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6bca3db8fa34f948a25621d348995f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lazy-loading 'flavor' on Instance uuid 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:39 user nova-compute[71347]: INFO nova.compute.manager [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Detaching volume 183777d6-8fe6-4b09-b33f-759cf148aac1
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:40 user nova-compute[71347]: INFO nova.compute.manager [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Attaching volume ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a to /dev/sdc
Apr 14 14:19:40 user nova-compute[71347]: INFO nova.virt.block_device [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Attempting to driver detach volume 183777d6-8fe6-4b09-b33f-759cf148aac1 from mountpoint /dev/vdb
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Attempting to detach device vdb from instance bc70d475-20dd-4859-a6fe-d2d09341799e from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:19:40 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:40 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:40 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:19:40 user nova-compute[71347]:   <serial>183777d6-8fe6-4b09-b33f-759cf148aac1</serial>
Apr 14 14:19:40 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:19:40 user nova-compute[71347]: </disk>
Apr 14 14:19:40 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:19:40 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Successfully detached device vdb from instance bc70d475-20dd-4859-a6fe-d2d09341799e from the persistent domain config.
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc70d475-20dd-4859-a6fe-d2d09341799e from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:19:40 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:40 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:40 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:19:40 user nova-compute[71347]:   <serial>183777d6-8fe6-4b09-b33f-759cf148aac1</serial>
Apr 14 14:19:40 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:19:40 user nova-compute[71347]: </disk>
Apr 14 14:19:40 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] No VIF found with MAC fa:16:3e:2e:88:dd, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.utils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[453171b9-249d-4406-8de0-4de39fbd3610]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c42398-c416-422b-91e3-069f50a7ecd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d82f6-05f2-4312-9045-3c8e007a5823]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c979361-33e5-4232-ad18-800835d81196]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:40 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23fde8e-c33a-43ea-89b4-920ba10a1471]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.utils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Updating existing volume attachment record: 0dc13804-ef7b-4151-ba8b-a2911ca811a1 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-295fa0f4-74f3-4e2c-ac33-6bf708ab622a tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.848s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681481980.4417377, bc70d475-20dd-4859-a6fe-d2d09341799e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc70d475-20dd-4859-a6fe-d2d09341799e {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:19:40 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Successfully detached device vdb from instance bc70d475-20dd-4859-a6fe-d2d09341799e from the live domain config.
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HcGKuZSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:40 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e16c4-912f-49b9-b2f6-cb2b321f024f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:19:40 user nova-compute[71347]: No targets found.
Apr 14 14:19:40 user nova-compute[71347]: iSNS:
Apr 14 14:19:40 user nova-compute[71347]: No targets found.
Apr 14 14:19:40 user nova-compute[71347]: STATIC:
Apr 14 14:19:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd
Apr 14 14:19:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1
Apr 14 14:19:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896
Apr 14 14:19:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:19:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:19:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:40 user nova-compute[71347]: FIRMWARE:
Apr 14 14:19:40 user nova-compute[71347]: No targets found.
Apr 14 14:19:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:19:40 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:19:40 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc0b690-cacf-4d92-8543-45267fdb7c1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[705fdd00-5f4f-4546-b0ea-8808e2632b6b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:40 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:40 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:40 user nova-compute[71347]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)
Apr 14 14:19:40 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:40 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:40 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:40 user nova-compute[71347]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 (non-flash)
Apr 14 14:19:40 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50077ac5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5692c902-f212-4605-9618-5bff8fdd86cd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8aa7ae-583c-48aa-a1df-8f0fee9ebaec]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[47524006-9693-4304-a5a2-56c8af5283b1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afdfc6a-3b03-497d-9f7b-11e406f5f7c5]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0abe7b-953c-4153-8d74-095dae79f9f4]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d43bf13-16cc-49ca-a981-d3da9cdaaa8c]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1, portal: 172.16.0.220,3260]
Apr 14 14:19:40 user nova-compute[71347]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183777d6-8fe6-4b09-b33f-759cf148aac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9e2547-17f8-4717-9de6-5c61e2f68311]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] <== disconnect_volume: return (291ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:19:40 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Successfully created port: 0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Successfully updated port: 0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquired lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG os_brick.utils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-changed-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Refreshing instance network info cache due to event network-changed-0653f24c-4a60-4257-afa3-74814f106945. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] Acquiring lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c0bac-067e-4ea8-b0c2-a7dd0034bb7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'flavor' on Instance uuid bc70d475-20dd-4859-a6fe-d2d09341799e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4d7c39-e491-4f3a-9a60-71b674f7b565]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e51758-b3f6-49fd-8313-9d2436157e82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9357bdaf-3347-4d9c-b7f6-8ff24dfea770]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-08716640-db38-4cb6-98e4-b2f1bd702905 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:41 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:19:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb336a7b-8c54-41de-b8bb-6bef8d54dae8]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:19:41 user nova-compute[71347]: DEBUG os_brick.utils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:41 user nova-compute[71347]: INFO nova.compute.manager [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Swapping volume 9c65a03b-5934-480a-9047-4182f7796fcd for 2c498d1f-d79d-49e7-8155-3da0efa7d798
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating instance_info_cache with network_info: [{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Releasing lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] Acquired lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.network.neutron [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Refreshing network info cache for port 0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converting VIF {"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG os_vif [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0653f24c-4a, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0653f24c-4a, col_values=(('external_ids', {'iface-id': '0653f24c-4a60-4257-afa3-74814f106945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:80:86', 'vm-uuid': 'dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: INFO os_vif [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a')
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converting VIF {"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] attach device xml: <interface type="ethernet">
Apr 14 14:19:42 user nova-compute[71347]:   <mac address="fa:16:3e:24:80:86"/>
Apr 14 14:19:42 user nova-compute[71347]:   <model type="virtio"/>
Apr 14 14:19:42 user nova-compute[71347]:   <mtu size="1442"/>
Apr 14 14:19:42 user nova-compute[71347]:   <target dev="tap0653f24c-4a"/>
Apr 14 14:19:42 user nova-compute[71347]: </interface>
Apr 14 14:19:42 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No BDM found with device name hda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No VIF found with MAC fa:16:3e:cf:76:28, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:19:42 user nova-compute[71347]:   <nova:package version="0.0.0"/>
Apr 14 14:19:42 user nova-compute[71347]:   <nova:name>tempest-device-tagging-server-1619832572</nova:name>
Apr 14 14:19:42 user nova-compute[71347]:   <nova:creationTime>2023-04-14 14:19:42</nova:creationTime>
Apr 14 14:19:42 user nova-compute[71347]:   <nova:flavor name="m1.nano">
Apr 14 14:19:42 user nova-compute[71347]:     <nova:memory>128</nova:memory>
Apr 14 14:19:42 user nova-compute[71347]:     <nova:disk>1</nova:disk>
Apr 14 14:19:42 user nova-compute[71347]:     <nova:swap>0</nova:swap>
Apr 14 14:19:42 user nova-compute[71347]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:19:42 user nova-compute[71347]:     <nova:vcpus>1</nova:vcpus>
Apr 14 14:19:42 user nova-compute[71347]:   </nova:flavor>
Apr 14 14:19:42 user nova-compute[71347]:   <nova:owner>
Apr 14 14:19:42 user nova-compute[71347]:     <nova:user uuid="ec166aaa170041c1a486379c7f417e66">tempest-TaggedAttachmentsTest-804560801-project-member</nova:user>
Apr 14 14:19:42 user nova-compute[71347]:     <nova:project uuid="d6bca3db8fa34f948a25621d348995f4">tempest-TaggedAttachmentsTest-804560801</nova:project>
Apr 14 14:19:42 user nova-compute[71347]:   </nova:owner>
Apr 14 14:19:42 user nova-compute[71347]:   <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:19:42 user nova-compute[71347]:   <nova:ports>
Apr 14 14:19:42 user nova-compute[71347]:     <nova:port uuid="93ca09be-6bf7-49fb-873a-b3236618a784">
Apr 14 14:19:42 user nova-compute[71347]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:19:42 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:42 user nova-compute[71347]:     <nova:port uuid="0653f24c-4a60-4257-afa3-74814f106945">
Apr 14 14:19:42 user nova-compute[71347]:       <nova:ip type="fixed" address="10.10.10.124" ipVersion="4"/>
Apr 14 14:19:42 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:42 user nova-compute[71347]:   </nova:ports>
Apr 14 14:19:42 user nova-compute[71347]: </nova:instance>
Apr 14 14:19:42 user nova-compute[71347]:  {{(pid=71347) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 14:19:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6a8c1be-0c8e-4796-9464-a6e2d40e3d77 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "interface-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.727s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG nova.network.neutron [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updated VIF entry in instance network info cache for port 0653f24c-4a60-4257-afa3-74814f106945. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG nova.network.neutron [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating instance_info_cache with network_info: [{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-eaab3de3-7118-4bcc-8af6-c3774dbd62c8 req-40a056a4-90c3-4a09-896c-8db0b9fe8bc4 service nova] Releasing lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'flavor' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] No waiting events found dispatching network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:43 user nova-compute[71347]: WARNING nova.compute.manager [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received unexpected event network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 for instance with vm_state active and task_state None.
Apr 14 14:19:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] No waiting events found dispatching network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:43 user nova-compute[71347]: WARNING nova.compute.manager [req-cd5e6722-b55a-4261-8c81-10b8ded75398 req-5559af8d-c371-4030-8a53-bd135f13cd72 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received unexpected event network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 for instance with vm_state active and task_state None.
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:43 user nova-compute[71347]: INFO nova.compute.manager [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Attaching volume bd055840-5942-4ab4-9f6a-4138dc80ddf8 to /dev/vdb
Apr 14 14:19:43 user nova-compute[71347]: DEBUG os_brick.utils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e69d5-5b44-4205-b3fb-2af2668cd8b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcff694-70d1-4beb-be3a-f27adedf024e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82dbd07-fd7f-434a-a73b-5c30efd5967a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2e4ec9-f19b-421f-b62d-3dbc56aaa006]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:43 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:19:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[376f2a5a-412f-4c90-a58d-1835b6b8ffe1]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG os_brick.utils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:43 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating existing volume attachment record: 2ff7f291-dd9d-4288-b4b6-c1ab10a394f9 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbdgVByZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:45 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:45 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:45 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c0c42-bf3e-4cae-9f1a-fa95e6938513]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:19:45 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[929e1def-485c-44a8-bf2c-1636ad2c3b0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a] added
Apr 14 14:19:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c9cf81-d993-4e45-afd4-156ec3dc4f41]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2959510e-18bb-4a9c-9c08-1357ec3a3999]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbdgVByZ {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbdgVByZ" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9514317-e9a7-4c16-82f8-dd7e46bab4a8]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vbdgVByZ'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[45894002-134f-4cc4-a54e-aa1531d5b4db]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275a452-5965-401a-85c7-378f211306dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c8f1fb-06cf-45cb-ab38-a763ec75f74d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a, portal: 172.16.0.220,3260]
Apr 14 14:19:45 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e6efc-3d94-4b26-b423-ff46a8be5d03]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1f8bff-f935-4885-bdbd-2820976dd45b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)
Apr 14 14:19:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:45 user nova-compute[71347]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)
Apr 14 14:19:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9e300-0a23-416b-9d16-baddb93f54e0]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:45 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqrHWDxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d417e09-6e54-4cad-91e5-7910ee4e784a', 'attached_at': '', 'detached_at': '', 'volume_id': '2c498d1f-d79d-49e7-8155-3da0efa7d798', 'serial': '2c498d1f-d79d-49e7-8155-3da0efa7d798'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '4d417e09-6e54-4cad-91e5-7910ee4e784a', 'attached_at': '', 'detached_at': '', 'volume_id': '9c65a03b-5934-480a-9047-4182f7796fcd', 'serial'} {{(pid=71347) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqrHWDxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:46 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbdgVByZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26262363138643931', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262363138643931', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.052s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:46 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:46 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lazy-loading 'flavor' on Instance uuid 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a48724-0575-42d1-a6f2-4e7662c31203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:19:46 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:19:46 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:46 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:46 user nova-compute[71347]:   <target dev="sdc" bus="scsi"/>
Apr 14 14:19:46 user nova-compute[71347]:   <serial>ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a</serial>
Apr 14 14:19:46 user nova-compute[71347]:   <address type="drive" controller="0" unit="2"/>
Apr 14 14:19:46 user nova-compute[71347]: </disk>
Apr 14 14:19:46 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bcca34-28ca-4f25-98bd-6235aa28fd89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798] added
Apr 14 14:19:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d684ccd1-7e99-4562-9f60-03f0dba707f3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[350a709c-a1d2-44a8-b4d7-e1d49fe2d8a4]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gqrHWDxt {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gqrHWDxt" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d1bdae-e9fe-40a7-9865-55d7d24dceb1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gqrHWDxt'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8b099d-6862-4864-82b6-8ae8ec0a716a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f8d040-2340-404f-92f6-b6dfad8cbccd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)
Apr 14 14:19:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)
Apr 14 14:19:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[200435fb-49fd-4dd1-9372-64839b541c7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798, portal: 172.16.0.220,3260]
Apr 14 14:19:46 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20af16-1bdf-4fd5-9182-d6feacf8507e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7565d915-8e57-48a2-88c1-7f6fef2d7597]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)
Apr 14 14:19:46 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[41212dda-6ebb-488e-a61b-5a0d66f43966]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqrHWDxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] No BDM found with device name sda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] No VIF found with MAC fa:16:3e:3d:cc:ea, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4f3bfd30-7eb4-4346-836d-29021667bd0b tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.145s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:47 user nova-compute[71347]: INFO nova.compute.manager [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Detaching volume ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a
Apr 14 14:19:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26161323839663862', 'path': '/dev/sdg'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161323839663862', 'path': '/dev/sdg'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lazy-loading 'flavor' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:47 user nova-compute[71347]: INFO nova.virt.block_device [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Attempting to driver detach volume ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a from mountpoint /dev/sdc
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Attempting to detach device sdc from instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:19:47 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:47 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:47 user nova-compute[71347]:   <target dev="sdc" bus="scsi"/>
Apr 14 14:19:47 user nova-compute[71347]:   <serial>ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a</serial>
Apr 14 14:19:47 user nova-compute[71347]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 14:19:47 user nova-compute[71347]: </disk>
Apr 14 14:19:47 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:19:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Successfully detached device sdc from instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d from the persistent domain config.
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:19:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:19:47 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:47 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:47 user nova-compute[71347]:   <target dev="sdc" bus="scsi"/>
Apr 14 14:19:47 user nova-compute[71347]:   <serial>ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a</serial>
Apr 14 14:19:47 user nova-compute[71347]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 14:19:47 user nova-compute[71347]: </disk>
Apr 14 14:19:47 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681481988.6427636, 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:19:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Successfully detached device sdc from instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d from the live domain config.
Apr 14 14:19:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbdgVByZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:48 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c35ba03-b22c-4b4a-b4a2-108459b82142]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:19:48 user nova-compute[71347]: No targets found.
Apr 14 14:19:48 user nova-compute[71347]: iSNS:
Apr 14 14:19:48 user nova-compute[71347]: No targets found.
Apr 14 14:19:48 user nova-compute[71347]: STATIC:
Apr 14 14:19:48 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a
Apr 14 14:19:48 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:48 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:48 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd
Apr 14 14:19:48 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:48 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:48 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798
Apr 14 14:19:48 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:48 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:48 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896
Apr 14 14:19:48 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:48 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:48 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:19:48 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:48 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:48 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:19:48 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:48 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:48 user nova-compute[71347]: FIRMWARE:
Apr 14 14:19:48 user nova-compute[71347]: No targets found.
Apr 14 14:19:48 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:19:48 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:19:48 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7d48c8-d4d7-4667-90aa-07ac791fb933]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa18eeb-8496-44f7-9c87-f68b02f6230e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:48 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a (non-flash)
Apr 14 14:19:48 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:48 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f500789f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb6c3d1-ba39-4013-bc95-7f3f3b3c3064]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8b1174-84ea-4556-a3e1-430d766c4626]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aba650-3940-49f2-9020-b79c65b75e1c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 101711872 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3bdfce-f576-47b8-8572-92f2a76c67d0]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1029c-07fc-4eef-b2a7-05566366cf39]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjDEnVAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:48 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded067b1-b529-4d18-8c9a-488d3a5a4cb0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a, portal: 172.16.0.220,3260]
Apr 14 14:19:48 user nova-compute[71347]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:48 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6dd4d4-a473-4a9a-ab84-8f9637cd6d5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbb6932-ddbe-486a-9835-d5257f04e8f2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] <== disconnect_volume: return (377ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.110s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:49 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:49 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[61457eba-6e68-44d9-9485-a4197c43418d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:19:49 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08fa54f-4bca-468a-86fc-cecf350e4e99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8] added
Apr 14 14:19:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[99420495-f671-4768-b64e-5b16196461f8]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa89ef-53b4-4ae7-911f-8b3fe74223f5]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rjDEnVAf {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rjDEnVAf" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b8a088-0c58-4cfa-bbf5-acfb5e8f800e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rjDEnVAf'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29a4544-d4a1-41a1-bd7b-fcf5b0875a00]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1cdf62-5e37-4a2b-9304-747c9c9a1989]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 261095424 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a571379-0175-4366-850e-77e38092d5ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8, portal: 172.16.0.220,3260]
Apr 14 14:19:49 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e98095-0540-482c-be45-1ae62b943889]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d377df3-3352-4390-bde0-eb0df15c3baf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:49 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81b3bf1-7b18-403c-a255-a18e45a1646f]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 343932928 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 490733568 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjDEnVAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '23036393830313463', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393830313463', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'flavor' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:19:50 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:50 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:50 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:19:50 user nova-compute[71347]:   <serial>bd055840-5942-4ab4-9f6a-4138dc80ddf8</serial>
Apr 14 14:19:50 user nova-compute[71347]: </disk>
Apr 14 14:19:50 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.objects.instance [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lazy-loading 'flavor' on Instance uuid 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-33cea86d-832b-4271-b4ff-632a3c466680 tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.767s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 652214272 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No BDM found with device name hda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:19:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] No VIF found with MAC fa:16:3e:cf:76:28, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2d27e512-3187-4f23-a370-e9208bd80535 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.500s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 806354944 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:51 user nova-compute[71347]: INFO nova.compute.manager [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Terminating instance
Apr 14 14:19:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 919601152 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received event network-vif-unplugged-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] No waiting events found dispatching network-vif-unplugged-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-d9bc71c8-9297-4cd8-bf2c-c8cac8382ad7 req-ea0b14cb-ecea-4559-8034-6f2be66f065d service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received event network-vif-unplugged-45351ca7-0534-4a7c-806b-71b0412f4e5d for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:19:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Instance destroyed successfully.
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.objects.instance [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lazy-loading 'resources' on Instance uuid 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-979930942',display_name='tempest-AttachSCSIVolumeTestJSON-server-979930942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-979930942',id=10,image_ref='010c8455-e9db-4040-a35b-69e3a49846c7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0Dp/TpbyfNMr6nxhQGUMBOdgpBxSCjIxFTiVwhiVsHPSIl1rtj9HKlYO1jqlh/TGAWy9mUUVXXk78x6JPTXxgIeAN5njjb1VP1diJqaaSnKLXj1ax1f6JAViJUmDdFYw==',key_name='tempest-keypair-1781102291',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f3e6748a8ce4ef0b22e272d19f6f584',ramdisk_id='',reservation_id='r-qer8jzre',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010c8455-e9db-4040-a35b-69e3a49846c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1519996642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1519996642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac3c91ffc9fe4c2a8afa04820908165a',uuid=14af0eec-8afa-4d4f-bc6a-3b04ff163e5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Converting VIF {"id": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "address": "fa:16:3e:3d:cc:ea", "network": {"id": "3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1497697248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f3e6748a8ce4ef0b22e272d19f6f584", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45351ca7-05", "ovs_interfaceid": "45351ca7-0534-4a7c-806b-71b0412f4e5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:cc:ea,bridge_name='br-int',has_traffic_filtering=True,id=45351ca7-0534-4a7c-806b-71b0412f4e5d,network=Network(3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45351ca7-05') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_vif [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:cc:ea,bridge_name='br-int',has_traffic_filtering=True,id=45351ca7-0534-4a7c-806b-71b0412f4e5d,network=Network(3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45351ca7-05') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45351ca7-05, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:52 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: INFO os_vif [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:cc:ea,bridge_name='br-int',has_traffic_filtering=True,id=45351ca7-0534-4a7c-806b-71b0412f4e5d,network=Network(3e737bce-1c54-4dd3-b2e6-32b7cf5fa7d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45351ca7-05')
Apr 14 14:19:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Deleting instance files /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d_del
Apr 14 14:19:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Deletion of /opt/stack/data/nova/instances/14af0eec-8afa-4d4f-bc6a-3b04ff163e5d_del complete
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5c71b6-9ff8-4e4a-bcc0-53cd98e7e88a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:19:52 user nova-compute[71347]: No targets found.
Apr 14 14:19:52 user nova-compute[71347]: iSNS:
Apr 14 14:19:52 user nova-compute[71347]: No targets found.
Apr 14 14:19:52 user nova-compute[71347]: STATIC:
Apr 14 14:19:52 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd
Apr 14 14:19:52 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:52 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:52 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798
Apr 14 14:19:52 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:52 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:52 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8
Apr 14 14:19:52 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:52 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:52 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896
Apr 14 14:19:52 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:52 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:52 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:19:52 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:52 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:52 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:19:52 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:52 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:52 user nova-compute[71347]: FIRMWARE:
Apr 14 14:19:52 user nova-compute[71347]: No targets found.
Apr 14 14:19:52 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:19:52 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:19:52 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6697dbb-1edd-4638-9e89-5948cf0e6608]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[534322bf-4f6d-42fc-90af-a57ef59161ca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:52 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:19:52 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:52 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd8220670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd'): ({'sdf'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Removing single pathed devices sdf {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:52 user nova-compute[71347]: INFO nova.compute.manager [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:19:52 user nova-compute[71347]: INFO nova.compute.manager [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Detaching volume bd055840-5942-4ab4-9f6a-4138dc80ddf8
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0bd9ac-05f9-4994-a232-139f3cc8f734]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d7575f-c2e0-4c6e-9a53-e817918a1591]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Flushing IO for device /dev/sdf {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[23773f9d-533f-4341-bcaa-99126c241676]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: INFO nova.virt.block_device [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Attempting to driver detach volume bd055840-5942-4ab4-9f6a-4138dc80ddf8 from mountpoint /dev/vdb
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Attempting to detach device vdb from instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:19:52 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:52 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:52 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:19:52 user nova-compute[71347]:   <serial>bd055840-5942-4ab4-9f6a-4138dc80ddf8</serial>
Apr 14 14:19:52 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 14:19:52 user nova-compute[71347]: </disk>
Apr 14 14:19:52 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1c147-09e2-458a-ad3d-07c5cfeb7cc8]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] SCSI volumes sdf have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Successfully detached device vdb from instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a from the persistent domain config.
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:19:52 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:19:52 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:19:52 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:19:52 user nova-compute[71347]:   <serial>bd055840-5942-4ab4-9f6a-4138dc80ddf8</serial>
Apr 14 14:19:52 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 14:19:52 user nova-compute[71347]: </disk>
Apr 14 14:19:52 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0ba0ec-ffd0-4dc3-9e34-db876a3f871f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9da0e3-7151-48f6-8f94-930ff9447070]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260]
Apr 14 14:19:52 user nova-compute[71347]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:52 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[960ae38b-32ab-471d-a329-d34f452c157e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] <== disconnect_volume: return (362ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqrHWDxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '4d417e09-6e54-4cad-91e5-7910ee4e784a', 'attached_at': '', 'detached_at': '', 'volume_id': '2c498d1f-d79d-49e7-8155-3da0efa7d798', 'serial'} {{(pid=71347) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 14:19:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] swap_volume: removing Cinder connection for volume 9c65a03b-5934-480a-9047-4182f7796fcd {{(pid=71347) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681481993.219984, dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:19:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Successfully detached device vdb from instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a from the live domain config.
Apr 14 14:19:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjDEnVAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:53 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece335e-7ec3-4d36-b6ce-81d6ce777174]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:19:53 user nova-compute[71347]: No targets found.
Apr 14 14:19:53 user nova-compute[71347]: iSNS:
Apr 14 14:19:53 user nova-compute[71347]: No targets found.
Apr 14 14:19:53 user nova-compute[71347]: STATIC:
Apr 14 14:19:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798
Apr 14 14:19:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8
Apr 14 14:19:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896
Apr 14 14:19:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:19:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:19:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:19:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:19:53 user nova-compute[71347]: FIRMWARE:
Apr 14 14:19:53 user nova-compute[71347]: No targets found.
Apr 14 14:19:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:19:53 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:19:53 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b510b96c-3584-49f1-9396-b9c368ec91a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf9f586-3b63-4668-935e-411c5f8f099a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)
Apr 14 14:19:53 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:53 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:53 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:53 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 (non-flash)
Apr 14 14:19:53 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:19:53 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:19:53 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:19:53 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:19:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5007742200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7ad851-30d9-4929-b58e-614a10d95eb3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b825c16-10a7-4049-be4a-70e065b269eb]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ab707b-2aa0-4f2e-8b31-eb2df6b9d738]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[26677888-5f2b-491f-a033-acd1c61637e3]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01c9f9-3c2d-48b4-a3c4-fe339a833550]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[56567c8d-430a-4e03-8e40-334bf35dc020]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8, portal: 172.16.0.220,3260]
Apr 14 14:19:53 user nova-compute[71347]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8, portal: 172.16.0.220,3260] successful.
Apr 14 14:19:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd055840-5942-4ab4-9f6a-4138dc80ddf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9293281-7beb-4cab-8d61-3774cc892e43]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] <== disconnect_volume: return (364ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] swap_volume: Updating volume 9c65a03b-5934-480a-9047-4182f7796fcd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "gqrHWDxt", "auth_password": "DzjS5TYZUI1ryG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "2c498d1f-d79d-49e7-8155-3da0efa7d798"}, "status": "reserved", "instance": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "attached_at": "", "detached_at": "", "volume_id": "2c498d1f-d79d-49e7-8155-3da0efa7d798", "serial": "2c498d1f-d79d-49e7-8155-3da0efa7d798"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2c498d1f-d79d-49e7-8155-3da0efa7d798', 'no_device': None, 'attachment_id': 'e34fc65f-c068-4687-b775-cf3f0247c086'} {{(pid=71347) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-41713c8f-c6ca-4927-97aa-e236ec99bfb9 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.389s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:54 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Took 1.36 seconds to deallocate network for instance.
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received event network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Acquiring lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] No waiting events found dispatching network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:54 user nova-compute[71347]: WARNING nova.compute.manager [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received unexpected event network-vif-plugged-45351ca7-0534-4a7c-806b-71b0412f4e5d for instance with vm_state deleted and task_state None.
Apr 14 14:19:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-484bc1bd-027e-468a-b2c4-05536812d510 req-c36eea7f-d84f-4d5f-a0bf-cab36645061b service nova] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Received event network-vif-deleted-45351ca7-0534-4a7c-806b-71b0412f4e5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'flavor' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG os_brick.utils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7abda4-a7b8-4efa-a143-30840c0ea60e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c10285a6-bfd0-4542-bf37-0ef943f5735e tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.998s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[de750704-bc08-46d4-aa53-514e3f764f29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[07402a98-bd3a-4ba9-834a-13e35278c93d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[517432a3-3730-417a-a0d7-a9e940661bde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:54 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Deleted allocations for instance 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d
Apr 14 14:19:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:19:54 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b23888-7e3f-4cfa-99f9-4e453f4f4d74]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG os_brick.utils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-17fe61c4-a221-4ae4-99b9-c9150a1c489e tempest-AttachSCSIVolumeTestJSON-1519996642 tempest-AttachSCSIVolumeTestJSON-1519996642-project-member] Lock "14af0eec-8afa-4d4f-bc6a-3b04ff163e5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.181s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:54 user nova-compute[71347]: INFO nova.compute.manager [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Swapping volume 2c498d1f-d79d-49e7-8155-3da0efa7d798 for 9c65a03b-5934-480a-9047-4182f7796fcd
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "interface-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-0653f24c-4a60-4257-afa3-74814f106945" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "interface-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-0653f24c-4a60-4257-afa3-74814f106945" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.objects.instance [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'flavor' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converting VIF {"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface> {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface> {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Attempting to detach device tap0653f24c-4a from instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] detach device xml: <interface type="ethernet">
Apr 14 14:19:55 user nova-compute[71347]:   <mac address="fa:16:3e:24:80:86"/>
Apr 14 14:19:55 user nova-compute[71347]:   <model type="virtio"/>
Apr 14 14:19:55 user nova-compute[71347]:   <mtu size="1442"/>
Apr 14 14:19:55 user nova-compute[71347]:   <target dev="tap0653f24c-4a"/>
Apr 14 14:19:55 user nova-compute[71347]: </interface>
Apr 14 14:19:55 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface> {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 14 14:19:55 user nova-compute[71347]:   <name>instance-0000000b</name>
Apr 14 14:19:55 user nova-compute[71347]:   <uuid>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</uuid>
Apr 14 14:19:55 user nova-compute[71347]:   <metadata>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:19:55 user nova-compute[71347]:   <nova:package version="0.0.0"/>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:name>tempest-device-tagging-server-1619832572</nova:name>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:creationTime>2023-04-14 14:19:42</nova:creationTime>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:flavor name="m1.nano">
Apr 14 14:19:55 user nova-compute[71347]:     <nova:memory>128</nova:memory>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:disk>1</nova:disk>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:swap>0</nova:swap>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:vcpus>1</nova:vcpus>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:flavor>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:owner>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:user uuid="ec166aaa170041c1a486379c7f417e66">tempest-TaggedAttachmentsTest-804560801-project-member</nova:user>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:project uuid="d6bca3db8fa34f948a25621d348995f4">tempest-TaggedAttachmentsTest-804560801</nova:project>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:owner>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:ports>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:port uuid="93ca09be-6bf7-49fb-873a-b3236618a784">
Apr 14 14:19:55 user nova-compute[71347]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:19:55 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:port uuid="0653f24c-4a60-4257-afa3-74814f106945">
Apr 14 14:19:55 user nova-compute[71347]:       <nova:ip type="fixed" address="10.10.10.124" ipVersion="4"/>
Apr 14 14:19:55 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:ports>
Apr 14 14:19:55 user nova-compute[71347]: </nova:instance>
Apr 14 14:19:55 user nova-compute[71347]:   </metadata>
Apr 14 14:19:55 user nova-compute[71347]:   <memory unit='KiB'>131072</memory>
Apr 14 14:19:55 user nova-compute[71347]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 14:19:55 user nova-compute[71347]:   <vcpu placement='static'>1</vcpu>
Apr 14 14:19:55 user nova-compute[71347]:   <resource>
Apr 14 14:19:55 user nova-compute[71347]:     <partition>/machine</partition>
Apr 14 14:19:55 user nova-compute[71347]:   </resource>
Apr 14 14:19:55 user nova-compute[71347]:   <sysinfo type='smbios'>
Apr 14 14:19:55 user nova-compute[71347]:     <system>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='version'>0.0.0</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='serial'>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='uuid'>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='family'>Virtual Machine</entry>
Apr 14 14:19:55 user nova-compute[71347]:     </system>
Apr 14 14:19:55 user nova-compute[71347]:   </sysinfo>
Apr 14 14:19:55 user nova-compute[71347]:   <os>
Apr 14 14:19:55 user nova-compute[71347]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 14:19:55 user nova-compute[71347]:     <boot dev='hd'/>
Apr 14 14:19:55 user nova-compute[71347]:     <smbios mode='sysinfo'/>
Apr 14 14:19:55 user nova-compute[71347]:   </os>
Apr 14 14:19:55 user nova-compute[71347]:   <features>
Apr 14 14:19:55 user nova-compute[71347]:     <acpi/>
Apr 14 14:19:55 user nova-compute[71347]:     <apic/>
Apr 14 14:19:55 user nova-compute[71347]:     <vmcoreinfo state='on'/>
Apr 14 14:19:55 user nova-compute[71347]:   </features>
Apr 14 14:19:55 user nova-compute[71347]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 14:19:55 user nova-compute[71347]:     <model fallback='forbid'>Nehalem</model>
Apr 14 14:19:55 user nova-compute[71347]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 14:19:55 user nova-compute[71347]:     <feature policy='require' name='vme'/>
Apr 14 14:19:55 user nova-compute[71347]:     <feature policy='require' name='x2apic'/>
Apr 14 14:19:55 user nova-compute[71347]:     <feature policy='require' name='hypervisor'/>
Apr 14 14:19:55 user nova-compute[71347]:   </cpu>
Apr 14 14:19:55 user nova-compute[71347]:   <clock offset='utc'>
Apr 14 14:19:55 user nova-compute[71347]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 14:19:55 user nova-compute[71347]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 14:19:55 user nova-compute[71347]:     <timer name='hpet' present='no'/>
Apr 14 14:19:55 user nova-compute[71347]:   </clock>
Apr 14 14:19:55 user nova-compute[71347]:   <on_poweroff>destroy</on_poweroff>
Apr 14 14:19:55 user nova-compute[71347]:   <on_reboot>restart</on_reboot>
Apr 14 14:19:55 user nova-compute[71347]:   <on_crash>destroy</on_crash>
Apr 14 14:19:55 user nova-compute[71347]:   <devices>
Apr 14 14:19:55 user nova-compute[71347]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 14:19:55 user nova-compute[71347]:     <disk type='file' device='disk'>
Apr 14 14:19:55 user nova-compute[71347]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 14:19:55 user nova-compute[71347]:       <source file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk' index='2'/>
Apr 14 14:19:55 user nova-compute[71347]:       <backingStore type='file' index='3'>
Apr 14 14:19:55 user nova-compute[71347]:         <format type='raw'/>
Apr 14 14:19:55 user nova-compute[71347]:         <source file='/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d'/>
Apr 14 14:19:55 user nova-compute[71347]:         <backingStore/>
Apr 14 14:19:55 user nova-compute[71347]:       </backingStore>
Apr 14 14:19:55 user nova-compute[71347]:       <target dev='vda' bus='virtio'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='virtio-disk0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </disk>
Apr 14 14:19:55 user nova-compute[71347]:     <disk type='file' device='cdrom'>
Apr 14 14:19:55 user nova-compute[71347]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 14:19:55 user nova-compute[71347]:       <source file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.config' index='1'/>
Apr 14 14:19:55 user nova-compute[71347]:       <backingStore/>
Apr 14 14:19:55 user nova-compute[71347]:       <target dev='hda' bus='ide'/>
Apr 14 14:19:55 user nova-compute[71347]:       <readonly/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='ide0-0-0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </disk>
Apr 14 14:19:55 user nova-compute[71347]:     <controller type='usb' index='0' model='none'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='usb'/>
Apr 14 14:19:55 user nova-compute[71347]:     </controller>
Apr 14 14:19:55 user nova-compute[71347]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='pci.0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </controller>
Apr 14 14:19:55 user nova-compute[71347]:     <controller type='ide' index='0'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='ide'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 14:19:55 user nova-compute[71347]:     </controller>
Apr 14 14:19:55 user nova-compute[71347]:     <interface type='ethernet'>
Apr 14 14:19:55 user nova-compute[71347]:       <mac address='fa:16:3e:cf:76:28'/>
Apr 14 14:19:55 user nova-compute[71347]:       <target dev='tap93ca09be-6b'/>
Apr 14 14:19:55 user nova-compute[71347]:       <model type='virtio'/>
Apr 14 14:19:55 user nova-compute[71347]:       <mtu size='1442'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='net0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </interface>
Apr 14 14:19:55 user nova-compute[71347]:     <interface type='ethernet'>
Apr 14 14:19:55 user nova-compute[71347]:       <mac address='fa:16:3e:24:80:86'/>
Apr 14 14:19:55 user nova-compute[71347]:       <target dev='tap0653f24c-4a'/>
Apr 14 14:19:55 user nova-compute[71347]:       <model type='virtio'/>
Apr 14 14:19:55 user nova-compute[71347]:       <mtu size='1442'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='net1'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </interface>
Apr 14 14:19:55 user nova-compute[71347]:     <serial type='pty'>
Apr 14 14:19:55 user nova-compute[71347]:       <source path='/dev/pts/10'/>
Apr 14 14:19:55 user nova-compute[71347]:       <log file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log' append='off'/>
Apr 14 14:19:55 user nova-compute[71347]:       <target type='isa-serial' port='0'>
Apr 14 14:19:55 user nova-compute[71347]:         <model name='isa-serial'/>
Apr 14 14:19:55 user nova-compute[71347]:       </target>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='serial0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </serial>
Apr 14 14:19:55 user nova-compute[71347]:     <console type='pty' tty='/dev/pts/10'>
Apr 14 14:19:55 user nova-compute[71347]:       <source path='/dev/pts/10'/>
Apr 14 14:19:55 user nova-compute[71347]:       <log file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log' append='off'/>
Apr 14 14:19:55 user nova-compute[71347]:       <target type='serial' port='0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='serial0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </console>
Apr 14 14:19:55 user nova-compute[71347]:     <input type='mouse' bus='ps2'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='input0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </input>
Apr 14 14:19:55 user nova-compute[71347]:     <input type='keyboard' bus='ps2'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='input1'/>
Apr 14 14:19:55 user nova-compute[71347]:     </input>
Apr 14 14:19:55 user nova-compute[71347]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 14 14:19:55 user nova-compute[71347]:       <listen type='address' address='0.0.0.0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </graphics>
Apr 14 14:19:55 user nova-compute[71347]:     <audio id='1' type='none'/>
Apr 14 14:19:55 user nova-compute[71347]:     <video>
Apr 14 14:19:55 user nova-compute[71347]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='video0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </video>
Apr 14 14:19:55 user nova-compute[71347]:     <memballoon model='virtio'>
Apr 14 14:19:55 user nova-compute[71347]:       <stats period='10'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='balloon0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </memballoon>
Apr 14 14:19:55 user nova-compute[71347]:     <rng model='virtio'>
Apr 14 14:19:55 user nova-compute[71347]:       <backend model='random'>/dev/urandom</backend>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='rng0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </rng>
Apr 14 14:19:55 user nova-compute[71347]:   </devices>
Apr 14 14:19:55 user nova-compute[71347]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 14:19:55 user nova-compute[71347]:     <label>libvirt-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</label>
Apr 14 14:19:55 user nova-compute[71347]:     <imagelabel>libvirt-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</imagelabel>
Apr 14 14:19:55 user nova-compute[71347]:   </seclabel>
Apr 14 14:19:55 user nova-compute[71347]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 14:19:55 user nova-compute[71347]:     <label>+64055:+108</label>
Apr 14 14:19:55 user nova-compute[71347]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 14:19:55 user nova-compute[71347]:   </seclabel>
Apr 14 14:19:55 user nova-compute[71347]: </domain>
Apr 14 14:19:55 user nova-compute[71347]:  {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 14:19:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Successfully detached device tap0653f24c-4a from instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a from the persistent domain config.
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] (1/8): Attempting to detach device tap0653f24c-4a with device alias net1 from instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] detach device xml: <interface type="ethernet">
Apr 14 14:19:55 user nova-compute[71347]:   <mac address="fa:16:3e:24:80:86"/>
Apr 14 14:19:55 user nova-compute[71347]:   <model type="virtio"/>
Apr 14 14:19:55 user nova-compute[71347]:   <mtu size="1442"/>
Apr 14 14:19:55 user nova-compute[71347]:   <target dev="tap0653f24c-4a"/>
Apr 14 14:19:55 user nova-compute[71347]: </interface>
Apr 14 14:19:55 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681481995.3457687, dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Start waiting for the detach event from libvirt for device tap0653f24c-4a with device alias net1 for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface> {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 14 14:19:55 user nova-compute[71347]:   <name>instance-0000000b</name>
Apr 14 14:19:55 user nova-compute[71347]:   <uuid>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</uuid>
Apr 14 14:19:55 user nova-compute[71347]:   <metadata>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:19:55 user nova-compute[71347]:   <nova:package version="0.0.0"/>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:name>tempest-device-tagging-server-1619832572</nova:name>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:creationTime>2023-04-14 14:19:42</nova:creationTime>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:flavor name="m1.nano">
Apr 14 14:19:55 user nova-compute[71347]:     <nova:memory>128</nova:memory>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:disk>1</nova:disk>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:swap>0</nova:swap>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:vcpus>1</nova:vcpus>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:flavor>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:owner>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:user uuid="ec166aaa170041c1a486379c7f417e66">tempest-TaggedAttachmentsTest-804560801-project-member</nova:user>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:project uuid="d6bca3db8fa34f948a25621d348995f4">tempest-TaggedAttachmentsTest-804560801</nova:project>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:owner>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:ports>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:port uuid="93ca09be-6bf7-49fb-873a-b3236618a784">
Apr 14 14:19:55 user nova-compute[71347]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:19:55 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:port uuid="0653f24c-4a60-4257-afa3-74814f106945">
Apr 14 14:19:55 user nova-compute[71347]:       <nova:ip type="fixed" address="10.10.10.124" ipVersion="4"/>
Apr 14 14:19:55 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:ports>
Apr 14 14:19:55 user nova-compute[71347]: </nova:instance>
Apr 14 14:19:55 user nova-compute[71347]:   </metadata>
Apr 14 14:19:55 user nova-compute[71347]:   <memory unit='KiB'>131072</memory>
Apr 14 14:19:55 user nova-compute[71347]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 14:19:55 user nova-compute[71347]:   <vcpu placement='static'>1</vcpu>
Apr 14 14:19:55 user nova-compute[71347]:   <resource>
Apr 14 14:19:55 user nova-compute[71347]:     <partition>/machine</partition>
Apr 14 14:19:55 user nova-compute[71347]:   </resource>
Apr 14 14:19:55 user nova-compute[71347]:   <sysinfo type='smbios'>
Apr 14 14:19:55 user nova-compute[71347]:     <system>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='version'>0.0.0</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='serial'>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='uuid'>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:19:55 user nova-compute[71347]:       <entry name='family'>Virtual Machine</entry>
Apr 14 14:19:55 user nova-compute[71347]:     </system>
Apr 14 14:19:55 user nova-compute[71347]:   </sysinfo>
Apr 14 14:19:55 user nova-compute[71347]:   <os>
Apr 14 14:19:55 user nova-compute[71347]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 14:19:55 user nova-compute[71347]:     <boot dev='hd'/>
Apr 14 14:19:55 user nova-compute[71347]:     <smbios mode='sysinfo'/>
Apr 14 14:19:55 user nova-compute[71347]:   </os>
Apr 14 14:19:55 user nova-compute[71347]:   <features>
Apr 14 14:19:55 user nova-compute[71347]:     <acpi/>
Apr 14 14:19:55 user nova-compute[71347]:     <apic/>
Apr 14 14:19:55 user nova-compute[71347]:     <vmcoreinfo state='on'/>
Apr 14 14:19:55 user nova-compute[71347]:   </features>
Apr 14 14:19:55 user nova-compute[71347]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 14:19:55 user nova-compute[71347]:     <model fallback='forbid'>Nehalem</model>
Apr 14 14:19:55 user nova-compute[71347]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 14:19:55 user nova-compute[71347]:     <feature policy='require' name='vme'/>
Apr 14 14:19:55 user nova-compute[71347]:     <feature policy='require' name='x2apic'/>
Apr 14 14:19:55 user nova-compute[71347]:     <feature policy='require' name='hypervisor'/>
Apr 14 14:19:55 user nova-compute[71347]:   </cpu>
Apr 14 14:19:55 user nova-compute[71347]:   <clock offset='utc'>
Apr 14 14:19:55 user nova-compute[71347]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 14:19:55 user nova-compute[71347]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 14:19:55 user nova-compute[71347]:     <timer name='hpet' present='no'/>
Apr 14 14:19:55 user nova-compute[71347]:   </clock>
Apr 14 14:19:55 user nova-compute[71347]:   <on_poweroff>destroy</on_poweroff>
Apr 14 14:19:55 user nova-compute[71347]:   <on_reboot>restart</on_reboot>
Apr 14 14:19:55 user nova-compute[71347]:   <on_crash>destroy</on_crash>
Apr 14 14:19:55 user nova-compute[71347]:   <devices>
Apr 14 14:19:55 user nova-compute[71347]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 14:19:55 user nova-compute[71347]:     <disk type='file' device='disk'>
Apr 14 14:19:55 user nova-compute[71347]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 14:19:55 user nova-compute[71347]:       <source file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk' index='2'/>
Apr 14 14:19:55 user nova-compute[71347]:       <backingStore type='file' index='3'>
Apr 14 14:19:55 user nova-compute[71347]:         <format type='raw'/>
Apr 14 14:19:55 user nova-compute[71347]:         <source file='/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d'/>
Apr 14 14:19:55 user nova-compute[71347]:         <backingStore/>
Apr 14 14:19:55 user nova-compute[71347]:       </backingStore>
Apr 14 14:19:55 user nova-compute[71347]:       <target dev='vda' bus='virtio'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='virtio-disk0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </disk>
Apr 14 14:19:55 user nova-compute[71347]:     <disk type='file' device='cdrom'>
Apr 14 14:19:55 user nova-compute[71347]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 14:19:55 user nova-compute[71347]:       <source file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.config' index='1'/>
Apr 14 14:19:55 user nova-compute[71347]:       <backingStore/>
Apr 14 14:19:55 user nova-compute[71347]:       <target dev='hda' bus='ide'/>
Apr 14 14:19:55 user nova-compute[71347]:       <readonly/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='ide0-0-0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </disk>
Apr 14 14:19:55 user nova-compute[71347]:     <controller type='usb' index='0' model='none'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='usb'/>
Apr 14 14:19:55 user nova-compute[71347]:     </controller>
Apr 14 14:19:55 user nova-compute[71347]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='pci.0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </controller>
Apr 14 14:19:55 user nova-compute[71347]:     <controller type='ide' index='0'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='ide'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 14:19:55 user nova-compute[71347]:     </controller>
Apr 14 14:19:55 user nova-compute[71347]:     <interface type='ethernet'>
Apr 14 14:19:55 user nova-compute[71347]:       <mac address='fa:16:3e:cf:76:28'/>
Apr 14 14:19:55 user nova-compute[71347]:       <target dev='tap93ca09be-6b'/>
Apr 14 14:19:55 user nova-compute[71347]:       <model type='virtio'/>
Apr 14 14:19:55 user nova-compute[71347]:       <mtu size='1442'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='net0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </interface>
Apr 14 14:19:55 user nova-compute[71347]:     <serial type='pty'>
Apr 14 14:19:55 user nova-compute[71347]:       <source path='/dev/pts/10'/>
Apr 14 14:19:55 user nova-compute[71347]:       <log file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log' append='off'/>
Apr 14 14:19:55 user nova-compute[71347]:       <target type='isa-serial' port='0'>
Apr 14 14:19:55 user nova-compute[71347]:         <model name='isa-serial'/>
Apr 14 14:19:55 user nova-compute[71347]:       </target>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='serial0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </serial>
Apr 14 14:19:55 user nova-compute[71347]:     <console type='pty' tty='/dev/pts/10'>
Apr 14 14:19:55 user nova-compute[71347]:       <source path='/dev/pts/10'/>
Apr 14 14:19:55 user nova-compute[71347]:       <log file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log' append='off'/>
Apr 14 14:19:55 user nova-compute[71347]:       <target type='serial' port='0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='serial0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </console>
Apr 14 14:19:55 user nova-compute[71347]:     <input type='mouse' bus='ps2'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='input0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </input>
Apr 14 14:19:55 user nova-compute[71347]:     <input type='keyboard' bus='ps2'>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='input1'/>
Apr 14 14:19:55 user nova-compute[71347]:     </input>
Apr 14 14:19:55 user nova-compute[71347]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 14 14:19:55 user nova-compute[71347]:       <listen type='address' address='0.0.0.0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </graphics>
Apr 14 14:19:55 user nova-compute[71347]:     <audio id='1' type='none'/>
Apr 14 14:19:55 user nova-compute[71347]:     <video>
Apr 14 14:19:55 user nova-compute[71347]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='video0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </video>
Apr 14 14:19:55 user nova-compute[71347]:     <memballoon model='virtio'>
Apr 14 14:19:55 user nova-compute[71347]:       <stats period='10'/>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='balloon0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </memballoon>
Apr 14 14:19:55 user nova-compute[71347]:     <rng model='virtio'>
Apr 14 14:19:55 user nova-compute[71347]:       <backend model='random'>/dev/urandom</backend>
Apr 14 14:19:55 user nova-compute[71347]:       <alias name='rng0'/>
Apr 14 14:19:55 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 14:19:55 user nova-compute[71347]:     </rng>
Apr 14 14:19:55 user nova-compute[71347]:   </devices>
Apr 14 14:19:55 user nova-compute[71347]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 14:19:55 user nova-compute[71347]:     <label>libvirt-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</label>
Apr 14 14:19:55 user nova-compute[71347]:     <imagelabel>libvirt-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</imagelabel>
Apr 14 14:19:55 user nova-compute[71347]:   </seclabel>
Apr 14 14:19:55 user nova-compute[71347]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 14:19:55 user nova-compute[71347]:     <label>+64055:+108</label>
Apr 14 14:19:55 user nova-compute[71347]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 14:19:55 user nova-compute[71347]:   </seclabel>
Apr 14 14:19:55 user nova-compute[71347]: </domain>
Apr 14 14:19:55 user nova-compute[71347]:  {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 14:19:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Successfully detached device tap0653f24c-4a from instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a from the live domain config.
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converting VIF {"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG os_vif [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0653f24c-4a, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:55 user nova-compute[71347]: INFO os_vif [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a')
Apr 14 14:19:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:19:55 user nova-compute[71347]:   <nova:package version="0.0.0"/>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:name>tempest-device-tagging-server-1619832572</nova:name>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:creationTime>2023-04-14 14:19:55</nova:creationTime>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:flavor name="m1.nano">
Apr 14 14:19:55 user nova-compute[71347]:     <nova:memory>128</nova:memory>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:disk>1</nova:disk>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:swap>0</nova:swap>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:vcpus>1</nova:vcpus>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:flavor>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:owner>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:user uuid="ec166aaa170041c1a486379c7f417e66">tempest-TaggedAttachmentsTest-804560801-project-member</nova:user>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:project uuid="d6bca3db8fa34f948a25621d348995f4">tempest-TaggedAttachmentsTest-804560801</nova:project>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:owner>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:19:55 user nova-compute[71347]:   <nova:ports>
Apr 14 14:19:55 user nova-compute[71347]:     <nova:port uuid="93ca09be-6bf7-49fb-873a-b3236618a784">
Apr 14 14:19:55 user nova-compute[71347]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:19:55 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:55 user nova-compute[71347]:   </nova:ports>
Apr 14 14:19:55 user nova-compute[71347]: </nova:instance>
Apr 14 14:19:55 user nova-compute[71347]:  {{(pid=71347) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-unplugged-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] No waiting events found dispatching network-vif-unplugged-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:56 user nova-compute[71347]: WARNING nova.compute.manager [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received unexpected event network-vif-unplugged-0653f24c-4a60-4257-afa3-74814f106945 for instance with vm_state active and task_state None.
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] No waiting events found dispatching network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:19:56 user nova-compute[71347]: WARNING nova.compute.manager [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received unexpected event network-vif-plugged-0653f24c-4a60-4257-afa3-74814f106945 for instance with vm_state active and task_state None.
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-deleted-0653f24c-4a60-4257-afa3-74814f106945 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:19:56 user nova-compute[71347]: INFO nova.compute.manager [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Neutron deleted interface 0653f24c-4a60-4257-afa3-74814f106945; detaching it from the instance and deleting it from the info cache
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating instance_info_cache with network_info: [{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:56 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:19:56 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7638MB free_disk=26.686233520507812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.objects.instance [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Lazy-loading 'system_metadata' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquired lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.network.neutron [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.objects.instance [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Lazy-loading 'flavor' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Converting VIF {"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface> {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 14 14:19:56 user nova-compute[71347]:   <name>instance-0000000b</name>
Apr 14 14:19:56 user nova-compute[71347]:   <uuid>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</uuid>
Apr 14 14:19:56 user nova-compute[71347]:   <metadata>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:19:56 user nova-compute[71347]:   <nova:package version="0.0.0"/>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:name>tempest-device-tagging-server-1619832572</nova:name>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:creationTime>2023-04-14 14:19:55</nova:creationTime>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:flavor name="m1.nano">
Apr 14 14:19:56 user nova-compute[71347]:     <nova:memory>128</nova:memory>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:disk>1</nova:disk>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:swap>0</nova:swap>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:vcpus>1</nova:vcpus>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:flavor>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:owner>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:user uuid="ec166aaa170041c1a486379c7f417e66">tempest-TaggedAttachmentsTest-804560801-project-member</nova:user>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:project uuid="d6bca3db8fa34f948a25621d348995f4">tempest-TaggedAttachmentsTest-804560801</nova:project>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:owner>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:ports>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:port uuid="93ca09be-6bf7-49fb-873a-b3236618a784">
Apr 14 14:19:56 user nova-compute[71347]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:19:56 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:ports>
Apr 14 14:19:56 user nova-compute[71347]: </nova:instance>
Apr 14 14:19:56 user nova-compute[71347]:   </metadata>
Apr 14 14:19:56 user nova-compute[71347]:   <memory unit='KiB'>131072</memory>
Apr 14 14:19:56 user nova-compute[71347]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 14:19:56 user nova-compute[71347]:   <vcpu placement='static'>1</vcpu>
Apr 14 14:19:56 user nova-compute[71347]:   <resource>
Apr 14 14:19:56 user nova-compute[71347]:     <partition>/machine</partition>
Apr 14 14:19:56 user nova-compute[71347]:   </resource>
Apr 14 14:19:56 user nova-compute[71347]:   <sysinfo type='smbios'>
Apr 14 14:19:56 user nova-compute[71347]:     <system>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='version'>0.0.0</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='serial'>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='uuid'>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='family'>Virtual Machine</entry>
Apr 14 14:19:56 user nova-compute[71347]:     </system>
Apr 14 14:19:56 user nova-compute[71347]:   </sysinfo>
Apr 14 14:19:56 user nova-compute[71347]:   <os>
Apr 14 14:19:56 user nova-compute[71347]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 14:19:56 user nova-compute[71347]:     <boot dev='hd'/>
Apr 14 14:19:56 user nova-compute[71347]:     <smbios mode='sysinfo'/>
Apr 14 14:19:56 user nova-compute[71347]:   </os>
Apr 14 14:19:56 user nova-compute[71347]:   <features>
Apr 14 14:19:56 user nova-compute[71347]:     <acpi/>
Apr 14 14:19:56 user nova-compute[71347]:     <apic/>
Apr 14 14:19:56 user nova-compute[71347]:     <vmcoreinfo state='on'/>
Apr 14 14:19:56 user nova-compute[71347]:   </features>
Apr 14 14:19:56 user nova-compute[71347]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 14:19:56 user nova-compute[71347]:     <model fallback='forbid'>Nehalem</model>
Apr 14 14:19:56 user nova-compute[71347]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 14:19:56 user nova-compute[71347]:     <feature policy='require' name='vme'/>
Apr 14 14:19:56 user nova-compute[71347]:     <feature policy='require' name='x2apic'/>
Apr 14 14:19:56 user nova-compute[71347]:     <feature policy='require' name='hypervisor'/>
Apr 14 14:19:56 user nova-compute[71347]:   </cpu>
Apr 14 14:19:56 user nova-compute[71347]:   <clock offset='utc'>
Apr 14 14:19:56 user nova-compute[71347]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 14:19:56 user nova-compute[71347]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 14:19:56 user nova-compute[71347]:     <timer name='hpet' present='no'/>
Apr 14 14:19:56 user nova-compute[71347]:   </clock>
Apr 14 14:19:56 user nova-compute[71347]:   <on_poweroff>destroy</on_poweroff>
Apr 14 14:19:56 user nova-compute[71347]:   <on_reboot>restart</on_reboot>
Apr 14 14:19:56 user nova-compute[71347]:   <on_crash>destroy</on_crash>
Apr 14 14:19:56 user nova-compute[71347]:   <devices>
Apr 14 14:19:56 user nova-compute[71347]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 14:19:56 user nova-compute[71347]:     <disk type='file' device='disk'>
Apr 14 14:19:56 user nova-compute[71347]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 14:19:56 user nova-compute[71347]:       <source file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk' index='2'/>
Apr 14 14:19:56 user nova-compute[71347]:       <backingStore type='file' index='3'>
Apr 14 14:19:56 user nova-compute[71347]:         <format type='raw'/>
Apr 14 14:19:56 user nova-compute[71347]:         <source file='/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d'/>
Apr 14 14:19:56 user nova-compute[71347]:         <backingStore/>
Apr 14 14:19:56 user nova-compute[71347]:       </backingStore>
Apr 14 14:19:56 user nova-compute[71347]:       <target dev='vda' bus='virtio'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='virtio-disk0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </disk>
Apr 14 14:19:56 user nova-compute[71347]:     <disk type='file' device='cdrom'>
Apr 14 14:19:56 user nova-compute[71347]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 14:19:56 user nova-compute[71347]:       <source file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.config' index='1'/>
Apr 14 14:19:56 user nova-compute[71347]:       <backingStore/>
Apr 14 14:19:56 user nova-compute[71347]:       <target dev='hda' bus='ide'/>
Apr 14 14:19:56 user nova-compute[71347]:       <readonly/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='ide0-0-0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </disk>
Apr 14 14:19:56 user nova-compute[71347]:     <controller type='usb' index='0' model='none'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='usb'/>
Apr 14 14:19:56 user nova-compute[71347]:     </controller>
Apr 14 14:19:56 user nova-compute[71347]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='pci.0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </controller>
Apr 14 14:19:56 user nova-compute[71347]:     <controller type='ide' index='0'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='ide'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 14:19:56 user nova-compute[71347]:     </controller>
Apr 14 14:19:56 user nova-compute[71347]:     <interface type='ethernet'>
Apr 14 14:19:56 user nova-compute[71347]:       <mac address='fa:16:3e:cf:76:28'/>
Apr 14 14:19:56 user nova-compute[71347]:       <target dev='tap93ca09be-6b'/>
Apr 14 14:19:56 user nova-compute[71347]:       <model type='virtio'/>
Apr 14 14:19:56 user nova-compute[71347]:       <mtu size='1442'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='net0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </interface>
Apr 14 14:19:56 user nova-compute[71347]:     <serial type='pty'>
Apr 14 14:19:56 user nova-compute[71347]:       <source path='/dev/pts/10'/>
Apr 14 14:19:56 user nova-compute[71347]:       <log file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log' append='off'/>
Apr 14 14:19:56 user nova-compute[71347]:       <target type='isa-serial' port='0'>
Apr 14 14:19:56 user nova-compute[71347]:         <model name='isa-serial'/>
Apr 14 14:19:56 user nova-compute[71347]:       </target>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='serial0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </serial>
Apr 14 14:19:56 user nova-compute[71347]:     <console type='pty' tty='/dev/pts/10'>
Apr 14 14:19:56 user nova-compute[71347]:       <source path='/dev/pts/10'/>
Apr 14 14:19:56 user nova-compute[71347]:       <log file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log' append='off'/>
Apr 14 14:19:56 user nova-compute[71347]:       <target type='serial' port='0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='serial0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </console>
Apr 14 14:19:56 user nova-compute[71347]:     <input type='mouse' bus='ps2'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='input0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </input>
Apr 14 14:19:56 user nova-compute[71347]:     <input type='keyboard' bus='ps2'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='input1'/>
Apr 14 14:19:56 user nova-compute[71347]:     </input>
Apr 14 14:19:56 user nova-compute[71347]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 14 14:19:56 user nova-compute[71347]:       <listen type='address' address='0.0.0.0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </graphics>
Apr 14 14:19:56 user nova-compute[71347]:     <audio id='1' type='none'/>
Apr 14 14:19:56 user nova-compute[71347]:     <video>
Apr 14 14:19:56 user nova-compute[71347]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='video0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </video>
Apr 14 14:19:56 user nova-compute[71347]:     <memballoon model='virtio'>
Apr 14 14:19:56 user nova-compute[71347]:       <stats period='10'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='balloon0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </memballoon>
Apr 14 14:19:56 user nova-compute[71347]:     <rng model='virtio'>
Apr 14 14:19:56 user nova-compute[71347]:       <backend model='random'>/dev/urandom</backend>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='rng0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </rng>
Apr 14 14:19:56 user nova-compute[71347]:   </devices>
Apr 14 14:19:56 user nova-compute[71347]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 14:19:56 user nova-compute[71347]:     <label>libvirt-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</label>
Apr 14 14:19:56 user nova-compute[71347]:     <imagelabel>libvirt-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</imagelabel>
Apr 14 14:19:56 user nova-compute[71347]:   </seclabel>
Apr 14 14:19:56 user nova-compute[71347]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 14:19:56 user nova-compute[71347]:     <label>+64055:+108</label>
Apr 14 14:19:56 user nova-compute[71347]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 14:19:56 user nova-compute[71347]:   </seclabel>
Apr 14 14:19:56 user nova-compute[71347]: </domain>
Apr 14 14:19:56 user nova-compute[71347]:  {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface> {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance bc70d475-20dd-4859-a6fe-d2d09341799e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56967036-c176-4423-aa3e-c78ee4e364ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:24:80:86"/><model type="virtio"/><mtu size="1442"/><target dev="tap0653f24c-4a"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 14 14:19:56 user nova-compute[71347]:   <name>instance-0000000b</name>
Apr 14 14:19:56 user nova-compute[71347]:   <uuid>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</uuid>
Apr 14 14:19:56 user nova-compute[71347]:   <metadata>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:19:56 user nova-compute[71347]:   <nova:package version="0.0.0"/>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:name>tempest-device-tagging-server-1619832572</nova:name>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:creationTime>2023-04-14 14:19:55</nova:creationTime>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:flavor name="m1.nano">
Apr 14 14:19:56 user nova-compute[71347]:     <nova:memory>128</nova:memory>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:disk>1</nova:disk>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:swap>0</nova:swap>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:vcpus>1</nova:vcpus>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:flavor>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:owner>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:user uuid="ec166aaa170041c1a486379c7f417e66">tempest-TaggedAttachmentsTest-804560801-project-member</nova:user>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:project uuid="d6bca3db8fa34f948a25621d348995f4">tempest-TaggedAttachmentsTest-804560801</nova:project>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:owner>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:ports>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:port uuid="93ca09be-6bf7-49fb-873a-b3236618a784">
Apr 14 14:19:56 user nova-compute[71347]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:19:56 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:ports>
Apr 14 14:19:56 user nova-compute[71347]: </nova:instance>
Apr 14 14:19:56 user nova-compute[71347]:   </metadata>
Apr 14 14:19:56 user nova-compute[71347]:   <memory unit='KiB'>131072</memory>
Apr 14 14:19:56 user nova-compute[71347]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 14:19:56 user nova-compute[71347]:   <vcpu placement='static'>1</vcpu>
Apr 14 14:19:56 user nova-compute[71347]:   <resource>
Apr 14 14:19:56 user nova-compute[71347]:     <partition>/machine</partition>
Apr 14 14:19:56 user nova-compute[71347]:   </resource>
Apr 14 14:19:56 user nova-compute[71347]:   <sysinfo type='smbios'>
Apr 14 14:19:56 user nova-compute[71347]:     <system>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='version'>0.0.0</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='serial'>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='uuid'>dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</entry>
Apr 14 14:19:56 user nova-compute[71347]:       <entry name='family'>Virtual Machine</entry>
Apr 14 14:19:56 user nova-compute[71347]:     </system>
Apr 14 14:19:56 user nova-compute[71347]:   </sysinfo>
Apr 14 14:19:56 user nova-compute[71347]:   <os>
Apr 14 14:19:56 user nova-compute[71347]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 14:19:56 user nova-compute[71347]:     <boot dev='hd'/>
Apr 14 14:19:56 user nova-compute[71347]:     <smbios mode='sysinfo'/>
Apr 14 14:19:56 user nova-compute[71347]:   </os>
Apr 14 14:19:56 user nova-compute[71347]:   <features>
Apr 14 14:19:56 user nova-compute[71347]:     <acpi/>
Apr 14 14:19:56 user nova-compute[71347]:     <apic/>
Apr 14 14:19:56 user nova-compute[71347]:     <vmcoreinfo state='on'/>
Apr 14 14:19:56 user nova-compute[71347]:   </features>
Apr 14 14:19:56 user nova-compute[71347]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 14:19:56 user nova-compute[71347]:     <model fallback='forbid'>Nehalem</model>
Apr 14 14:19:56 user nova-compute[71347]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 14:19:56 user nova-compute[71347]:     <feature policy='require' name='vme'/>
Apr 14 14:19:56 user nova-compute[71347]:     <feature policy='require' name='x2apic'/>
Apr 14 14:19:56 user nova-compute[71347]:     <feature policy='require' name='hypervisor'/>
Apr 14 14:19:56 user nova-compute[71347]:   </cpu>
Apr 14 14:19:56 user nova-compute[71347]:   <clock offset='utc'>
Apr 14 14:19:56 user nova-compute[71347]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 14:19:56 user nova-compute[71347]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 14:19:56 user nova-compute[71347]:     <timer name='hpet' present='no'/>
Apr 14 14:19:56 user nova-compute[71347]:   </clock>
Apr 14 14:19:56 user nova-compute[71347]:   <on_poweroff>destroy</on_poweroff>
Apr 14 14:19:56 user nova-compute[71347]:   <on_reboot>restart</on_reboot>
Apr 14 14:19:56 user nova-compute[71347]:   <on_crash>destroy</on_crash>
Apr 14 14:19:56 user nova-compute[71347]:   <devices>
Apr 14 14:19:56 user nova-compute[71347]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 14:19:56 user nova-compute[71347]:     <disk type='file' device='disk'>
Apr 14 14:19:56 user nova-compute[71347]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 14:19:56 user nova-compute[71347]:       <source file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk' index='2'/>
Apr 14 14:19:56 user nova-compute[71347]:       <backingStore type='file' index='3'>
Apr 14 14:19:56 user nova-compute[71347]:         <format type='raw'/>
Apr 14 14:19:56 user nova-compute[71347]:         <source file='/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d'/>
Apr 14 14:19:56 user nova-compute[71347]:         <backingStore/>
Apr 14 14:19:56 user nova-compute[71347]:       </backingStore>
Apr 14 14:19:56 user nova-compute[71347]:       <target dev='vda' bus='virtio'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='virtio-disk0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </disk>
Apr 14 14:19:56 user nova-compute[71347]:     <disk type='file' device='cdrom'>
Apr 14 14:19:56 user nova-compute[71347]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 14:19:56 user nova-compute[71347]:       <source file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/disk.config' index='1'/>
Apr 14 14:19:56 user nova-compute[71347]:       <backingStore/>
Apr 14 14:19:56 user nova-compute[71347]:       <target dev='hda' bus='ide'/>
Apr 14 14:19:56 user nova-compute[71347]:       <readonly/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='ide0-0-0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </disk>
Apr 14 14:19:56 user nova-compute[71347]:     <controller type='usb' index='0' model='none'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='usb'/>
Apr 14 14:19:56 user nova-compute[71347]:     </controller>
Apr 14 14:19:56 user nova-compute[71347]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='pci.0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </controller>
Apr 14 14:19:56 user nova-compute[71347]:     <controller type='ide' index='0'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='ide'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 14:19:56 user nova-compute[71347]:     </controller>
Apr 14 14:19:56 user nova-compute[71347]:     <interface type='ethernet'>
Apr 14 14:19:56 user nova-compute[71347]:       <mac address='fa:16:3e:cf:76:28'/>
Apr 14 14:19:56 user nova-compute[71347]:       <target dev='tap93ca09be-6b'/>
Apr 14 14:19:56 user nova-compute[71347]:       <model type='virtio'/>
Apr 14 14:19:56 user nova-compute[71347]:       <mtu size='1442'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='net0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </interface>
Apr 14 14:19:56 user nova-compute[71347]:     <serial type='pty'>
Apr 14 14:19:56 user nova-compute[71347]:       <source path='/dev/pts/10'/>
Apr 14 14:19:56 user nova-compute[71347]:       <log file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log' append='off'/>
Apr 14 14:19:56 user nova-compute[71347]:       <target type='isa-serial' port='0'>
Apr 14 14:19:56 user nova-compute[71347]:         <model name='isa-serial'/>
Apr 14 14:19:56 user nova-compute[71347]:       </target>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='serial0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </serial>
Apr 14 14:19:56 user nova-compute[71347]:     <console type='pty' tty='/dev/pts/10'>
Apr 14 14:19:56 user nova-compute[71347]:       <source path='/dev/pts/10'/>
Apr 14 14:19:56 user nova-compute[71347]:       <log file='/opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a/console.log' append='off'/>
Apr 14 14:19:56 user nova-compute[71347]:       <target type='serial' port='0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='serial0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </console>
Apr 14 14:19:56 user nova-compute[71347]:     <input type='mouse' bus='ps2'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='input0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </input>
Apr 14 14:19:56 user nova-compute[71347]:     <input type='keyboard' bus='ps2'>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='input1'/>
Apr 14 14:19:56 user nova-compute[71347]:     </input>
Apr 14 14:19:56 user nova-compute[71347]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 14 14:19:56 user nova-compute[71347]:       <listen type='address' address='0.0.0.0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </graphics>
Apr 14 14:19:56 user nova-compute[71347]:     <audio id='1' type='none'/>
Apr 14 14:19:56 user nova-compute[71347]:     <video>
Apr 14 14:19:56 user nova-compute[71347]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='video0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </video>
Apr 14 14:19:56 user nova-compute[71347]:     <memballoon model='virtio'>
Apr 14 14:19:56 user nova-compute[71347]:       <stats period='10'/>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='balloon0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </memballoon>
Apr 14 14:19:56 user nova-compute[71347]:     <rng model='virtio'>
Apr 14 14:19:56 user nova-compute[71347]:       <backend model='random'>/dev/urandom</backend>
Apr 14 14:19:56 user nova-compute[71347]:       <alias name='rng0'/>
Apr 14 14:19:56 user nova-compute[71347]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 14:19:56 user nova-compute[71347]:     </rng>
Apr 14 14:19:56 user nova-compute[71347]:   </devices>
Apr 14 14:19:56 user nova-compute[71347]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 14:19:56 user nova-compute[71347]:     <label>libvirt-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</label>
Apr 14 14:19:56 user nova-compute[71347]:     <imagelabel>libvirt-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a</imagelabel>
Apr 14 14:19:56 user nova-compute[71347]:   </seclabel>
Apr 14 14:19:56 user nova-compute[71347]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 14:19:56 user nova-compute[71347]:     <label>+64055:+108</label>
Apr 14 14:19:56 user nova-compute[71347]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 14:19:56 user nova-compute[71347]:   </seclabel>
Apr 14 14:19:56 user nova-compute[71347]: </domain>
Apr 14 14:19:56 user nova-compute[71347]:  {{(pid=71347) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 14:19:56 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Detaching interface fa:16:3e:24:80:86 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0653f24c-4a' not found.
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Converting VIF {"id": "0653f24c-4a60-4257-afa3-74814f106945", "address": "fa:16:3e:24:80:86", "network": {"id": "d745af4d-df01-4467-bda6-07840054785a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1308916216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0653f24c-4a", "ovs_interfaceid": "0653f24c-4a60-4257-afa3-74814f106945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG os_vif [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0653f24c-4a, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:19:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:19:56 user nova-compute[71347]: INFO os_vif [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:86,bridge_name='br-int',has_traffic_filtering=True,id=0653f24c-4a60-4257-afa3-74814f106945,network=Network(d745af4d-df01-4467-bda6-07840054785a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0653f24c-4a')
Apr 14 14:19:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [req-2bab9df8-44ec-4a24-835c-f209851376c1 req-c2f4f7fe-6499-4d6b-9166-b5650ac164e4 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:19:56 user nova-compute[71347]:   <nova:package version="0.0.0"/>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:name>tempest-device-tagging-server-1619832572</nova:name>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:creationTime>2023-04-14 14:19:56</nova:creationTime>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:flavor name="m1.nano">
Apr 14 14:19:56 user nova-compute[71347]:     <nova:memory>128</nova:memory>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:disk>1</nova:disk>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:swap>0</nova:swap>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:vcpus>1</nova:vcpus>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:flavor>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:owner>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:user uuid="ec166aaa170041c1a486379c7f417e66">tempest-TaggedAttachmentsTest-804560801-project-member</nova:user>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:project uuid="d6bca3db8fa34f948a25621d348995f4">tempest-TaggedAttachmentsTest-804560801</nova:project>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:owner>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:19:56 user nova-compute[71347]:   <nova:ports>
Apr 14 14:19:56 user nova-compute[71347]:     <nova:port uuid="93ca09be-6bf7-49fb-873a-b3236618a784">
Apr 14 14:19:56 user nova-compute[71347]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:19:56 user nova-compute[71347]:     </nova:port>
Apr 14 14:19:56 user nova-compute[71347]:   </nova:ports>
Apr 14 14:19:56 user nova-compute[71347]: </nova:instance>
Apr 14 14:19:56 user nova-compute[71347]:  {{(pid=71347) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 14:19:57 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:19:57 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:19:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:19:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:57 user nova-compute[71347]: DEBUG nova.network.neutron [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating instance_info_cache with network_info: [{"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Releasing lock "refresh_cache-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-13dc0677-72ca-4934-967a-682a276b5684 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "interface-dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-0653f24c-4a60-4257-afa3-74814f106945" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.259s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:19:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Updating instance_info_cache with network_info: [{"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:19:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d417e09-6e54-4cad-91e5-7910ee4e784a', 'attached_at': '', 'detached_at': '', 'volume_id': '9c65a03b-5934-480a-9047-4182f7796fcd', 'serial': '9c65a03b-5934-480a-9047-4182f7796fcd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqrHWDxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '2c498d1f-d79d-49e7-8155-3da0efa7d798'}, 'status': 'reserved', 'instance': '4d417e09-6e54-4cad-91e5-7910ee4e784a', 'attached_at': '', 'detached_at': '', 'volume_id': '2c498d1f-d79d-49e7-8155-3da0efa7d798', 'serial'} {{(pid=71347) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:20:01 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:20:01 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:20:01 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccab108-15a4-4b4d-a6fd-8a20aaa36c12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:20:01 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5214bbed-a886-4458-8092-197589a23aa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd] added
Apr 14 14:20:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccece51-2691-4c69-b107-8baa822f083f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cedc86-c546-4a1e-bc3e-ccb9fc865c22]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJlhdKMn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WJlhdKMn" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac258e0a-3b82-4587-a938-d4866567a4bc]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WJlhdKMn'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[380d1d2a-236b-4eac-a20c-b2c74006c881]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb7424-cb0d-4f52-8d16-8a9f9ab9695e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedd52a5-6137-4dca-b75b-a12f9fb9b6a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260]
Apr 14 14:20:01 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260] successful.
Apr 14 14:20:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0063024-72fb-4aee-9dff-752b91e3e6b6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1537f5-d573-4bca-ac49-6c0ace282767]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:20:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8160bb-06df-4fa9-b61f-565af59a94c3]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:20:02 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:20:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:20:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:20:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23063326133393632', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:20:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063326133393632', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:20:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lazy-loading 'flavor' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:20:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 135266304 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:20:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:20:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 459276288 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:20:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 622854144 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:20:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 760217600 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 924844032 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqrHWDxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '2c498d1f-d79d-49e7-8155-3da0efa7d798': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:20:06 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9833fe-7365-4574-97c3-4bde81f88915]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:20:06 user nova-compute[71347]: No targets found.
Apr 14 14:20:06 user nova-compute[71347]: iSNS:
Apr 14 14:20:06 user nova-compute[71347]: No targets found.
Apr 14 14:20:06 user nova-compute[71347]: STATIC:
Apr 14 14:20:06 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd
Apr 14 14:20:06 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:06 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:06 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798
Apr 14 14:20:06 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:06 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:06 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896
Apr 14 14:20:06 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:06 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:06 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:20:06 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:06 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:06 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:20:06 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:06 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:06 user nova-compute[71347]: FIRMWARE:
Apr 14 14:20:06 user nova-compute[71347]: No targets found.
Apr 14 14:20:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:20:06 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:20:06 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a625cbf-e198-461b-93a9-35c23488918a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e48b8b0-757f-4daf-8eb8-396286536090]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:20:06 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:06 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:06 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:06 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:20:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:20:06 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:06 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:06 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:06 user nova-compute[71347]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 (non-flash)
Apr 14 14:20:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ff81b4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798'): ({'sdg'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Removing single pathed devices sdg {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddcfecd-65d3-4c88-8bac-a068088134c2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2786bd-8e63-4686-b114-a1fd0f9505e3]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Flushing IO for device /dev/sdg {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3200229d-f905-47d3-b082-75012be00217]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[87803046-2ea5-4207-a1dd-01b7e8d0083d]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] SCSI volumes sdg have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[88898460-c1f6-4cee-bfc0-a31f4e440d31]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da5655a-f059-4181-a780-534b5a25cb88]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798, portal: 172.16.0.220,3260]
Apr 14 14:20:06 user nova-compute[71347]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798, portal: 172.16.0.220,3260] successful.
Apr 14 14:20:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c498d1f-d79d-49e7-8155-3da0efa7d798 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf76289f-c05e-41df-abee-bfaa7b33677a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] <== disconnect_volume: return (328ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:20:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:20:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '4d417e09-6e54-4cad-91e5-7910ee4e784a', 'attached_at': '', 'detached_at': '', 'volume_id': '9c65a03b-5934-480a-9047-4182f7796fcd', 'serial'} {{(pid=71347) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 14:20:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] swap_volume: removing Cinder connection for volume 2c498d1f-d79d-49e7-8155-3da0efa7d798 {{(pid=71347) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 14:20:07 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681481992.507012, 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:20:07 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] VM Stopped (Lifecycle Event)
Apr 14 14:20:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f391f395-b032-4cfe-a3b3-f98f03564e02 None None] [instance: 14af0eec-8afa-4d4f-bc6a-3b04ff163e5d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:20:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] swap_volume: Updating volume 2c498d1f-d79d-49e7-8155-3da0efa7d798 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WJlhdKMn", "auth_password": "Wo6eZmJRxFTEGn", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "9c65a03b-5934-480a-9047-4182f7796fcd"}, "status": "reserved", "instance": "4d417e09-6e54-4cad-91e5-7910ee4e784a", "attached_at": "", "detached_at": "", "volume_id": "9c65a03b-5934-480a-9047-4182f7796fcd", "serial": "9c65a03b-5934-480a-9047-4182f7796fcd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9c65a03b-5934-480a-9047-4182f7796fcd', 'no_device': None, 'attachment_id': '2213f169-62ec-47b3-ab36-ca291edc9739'} {{(pid=71347) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 14:20:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-66644031-7705-40aa-bd18-7b4df1e0bca2 tempest-TestVolumeSwap-25650586 tempest-TestVolumeSwap-25650586-project-admin] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.066s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:10 user nova-compute[71347]: INFO nova.compute.manager [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Detaching volume 9c65a03b-5934-480a-9047-4182f7796fcd
Apr 14 14:20:10 user nova-compute[71347]: INFO nova.virt.block_device [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Attempting to driver detach volume 9c65a03b-5934-480a-9047-4182f7796fcd from mountpoint /dev/vdb
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Attempting to detach device vdb from instance 4d417e09-6e54-4cad-91e5-7910ee4e784a from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:20:10 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:20:10 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:20:10 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:20:10 user nova-compute[71347]:   <serial>9c65a03b-5934-480a-9047-4182f7796fcd</serial>
Apr 14 14:20:10 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:20:10 user nova-compute[71347]: </disk>
Apr 14 14:20:10 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:20:10 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Successfully detached device vdb from instance 4d417e09-6e54-4cad-91e5-7910ee4e784a from the persistent domain config.
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d417e09-6e54-4cad-91e5-7910ee4e784a from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:20:10 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:20:10 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:20:10 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:20:10 user nova-compute[71347]:   <serial>9c65a03b-5934-480a-9047-4182f7796fcd</serial>
Apr 14 14:20:10 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:20:10 user nova-compute[71347]: </disk>
Apr 14 14:20:10 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482010.5694258, 4d417e09-6e54-4cad-91e5-7910ee4e784a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:20:10 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Successfully detached device vdb from instance 4d417e09-6e54-4cad-91e5-7910ee4e784a from the live domain config.
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WJlhdKMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '9c65a03b-5934-480a-9047-4182f7796fcd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:20:10 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b3d81-5a8e-49ae-8ea5-361153add10f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:20:10 user nova-compute[71347]: No targets found.
Apr 14 14:20:10 user nova-compute[71347]: iSNS:
Apr 14 14:20:10 user nova-compute[71347]: No targets found.
Apr 14 14:20:10 user nova-compute[71347]: STATIC:
Apr 14 14:20:10 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd
Apr 14 14:20:10 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:10 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:10 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896
Apr 14 14:20:10 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:10 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:10 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:20:10 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:10 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:10 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:20:10 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:10 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:10 user nova-compute[71347]: FIRMWARE:
Apr 14 14:20:10 user nova-compute[71347]: No targets found.
Apr 14 14:20:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:20:10 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:20:10 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a592d085-a1d3-4657-b161-51accbb45727]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8242b98-2ce3-414f-8cf4-cc8ac58db11a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:20:10 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:10 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:10 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd (non-flash)
Apr 14 14:20:10 user nova-compute[71347]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:10 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:10 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd82220e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-changed-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing instance network info cache due to event network-changed-6b29f14f-01b4-49bc-80ff-6e0a062c47a2. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] Acquiring lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] Acquired lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG nova.network.neutron [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Refreshing network info cache for port 6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[777969e8-052c-45f6-99a5-98264ac48297]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e0b19f-15d6-4678-9f83-ce539d02d281]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f224aa9-5afb-41cc-a00a-5ab6ad38757b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f6b5e-51af-4292-92b8-69dfaf3f55df]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e3a182-bdbc-4a8f-b367-b9e64940a72e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa743e8-207d-444c-aaa7-f4e950ea4054]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260]
Apr 14 14:20:11 user nova-compute[71347]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd, portal: 172.16.0.220,3260] successful.
Apr 14 14:20:11 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c65a03b-5934-480a-9047-4182f7796fcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f4818e-12a1-44de-b925-61c205dd570f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] <== disconnect_volume: return (330ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updated VIF entry in instance network info cache for port 6b29f14f-01b4-49bc-80ff-6e0a062c47a2. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [{"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cb1f68ec-2412-4ab3-8bc2-9cf099584cb9 req-5351a883-3ff6-4d0d-a4cc-14e257ef7ebc service nova] Releasing lock "refresh_cache-56967036-c176-4423-aa3e-c78ee4e364ac" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:20:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:12 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lazy-loading 'flavor' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ad549c34-45c7-419d-8c5e-9490ed92ce58 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.795s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "56967036-c176-4423-aa3e-c78ee4e364ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:13 user nova-compute[71347]: INFO nova.compute.manager [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Terminating instance
Apr 14 14:20:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-unplugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-2a590d28-a7a3-4f50-8946-d09983a0c3ee req-165f3bb3-bcc1-4ade-8f70-fd03e899bf96 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-unplugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-d6f22a05-3e44-4a14-bfaf-93d257ec751e req-11b86379-68d8-4138-8667-7001cbf040e6 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-unplugged-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-b61c1a23-b90f-4abc-886a-012d942fff7d req-cc315ba5-88e7-4d34-bdec-619dca8cad7f service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-e060de39-0ed8-4aa3-9046-222f9254ddfe for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:14 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Instance destroyed successfully.
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lazy-loading 'resources' on Instance uuid 56967036-c176-4423-aa3e-c78ee4e364ac {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=6b29f14f-01b4-49bc-80ff-6e0a062c47a2,network=Network(5d0243d2-2246-4474-a20b-7456780b2a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b29f14f-01') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=6b29f14f-01b4-49bc-80ff-6e0a062c47a2,network=Network(5d0243d2-2246-4474-a20b-7456780b2a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b29f14f-01') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b29f14f-01, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:14 user nova-compute[71347]: INFO os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=6b29f14f-01b4-49bc-80ff-6e0a062c47a2,network=Network(5d0243d2-2246-4474-a20b-7456780b2a1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b29f14f-01')
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=cc5e8a3d-7a5f-4cd7-907b-6c91f479b371,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc5e8a3d-7a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=cc5e8a3d-7a5f-4cd7-907b-6c91f479b371,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc5e8a3d-7a') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc5e8a3d-7a, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: INFO os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:56:eb,bridge_name='br-int',has_traffic_filtering=True,id=cc5e8a3d-7a5f-4cd7-907b-6c91f479b371,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc5e8a3d-7a')
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a0:1b,bridge_name='br-int',has_traffic_filtering=True,id=d6821969-0f10-4fd6-9c25-0a52e658eca6,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6821969-0f') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a0:1b,bridge_name='br-int',has_traffic_filtering=True,id=d6821969-0f10-4fd6-9c25-0a52e658eca6,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6821969-0f') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6821969-0f, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: INFO os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a0:1b,bridge_name='br-int',has_traffic_filtering=True,id=d6821969-0f10-4fd6-9c25-0a52e658eca6,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd6821969-0f')
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "address": "fa:16:3e:e1:3f:7f", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bfcc6b7-67", "ovs_interfaceid": "3bfcc6b7-6768-47b7-ae40-f951761442a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:7f,bridge_name='br-int',has_traffic_filtering=True,id=3bfcc6b7-6768-47b7-ae40-f951761442a5,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfcc6b7-67') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:7f,bridge_name='br-int',has_traffic_filtering=True,id=3bfcc6b7-6768-47b7-ae40-f951761442a5,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfcc6b7-67') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bfcc6b7-67, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: INFO os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:7f,bridge_name='br-int',has_traffic_filtering=True,id=3bfcc6b7-6768-47b7-ae40-f951761442a5,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bfcc6b7-67')
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=2f7a292d-75de-404e-bb4c-93e2bc9d190b,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7a292d-75') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=2f7a292d-75de-404e-bb4c-93e2bc9d190b,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7a292d-75') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f7a292d-75, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: INFO os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:6e:45,bridge_name='br-int',has_traffic_filtering=True,id=2f7a292d-75de-404e-bb4c-93e2bc9d190b,network=Network(d7cfa24f-ac75-41ae-a03c-aadea36f3fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7a292d-75')
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f5:b1,bridge_name='br-int',has_traffic_filtering=True,id=e060de39-0ed8-4aa3-9046-222f9254ddfe,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060de39-0e') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f5:b1,bridge_name='br-int',has_traffic_filtering=True,id=e060de39-0ed8-4aa3-9046-222f9254ddfe,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060de39-0e') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape060de39-0e, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: INFO os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f5:b1,bridge_name='br-int',has_traffic_filtering=True,id=e060de39-0ed8-4aa3-9046-222f9254ddfe,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape060de39-0e')
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1806973002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1806973002',id=12,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMStINZRIc53P2ujvOjS4yZDo9DiMwbAvzAkyQwRl6UFh/TMjh1q5gGFo7TUfdr3oQHJqkvZAbmRMgbR6+IphcziHkR+/yl7iyga6TuoF5I6jnQZ02sVPjfbIGTAxbK2Yg==',key_name='tempest-keypair-1171371252',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1da7ba7bdb124c3880e3394d3bbab296',ramdisk_id='',reservation_id='r-khrykbzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1582702370',owner_user_name='tempest-TaggedBootDevicesTest_v242-1582702370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c520c20d1b9f43dc8bf2517dffd76bea',uuid=56967036-c176-4423-aa3e-c78ee4e364ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converting VIF {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:e0,bridge_name='br-int',has_traffic_filtering=True,id=7923b754-a636-4e91-b166-ce9b0c0fce99,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7923b754-a6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:e0,bridge_name='br-int',has_traffic_filtering=True,id=7923b754-a636-4e91-b166-ce9b0c0fce99,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7923b754-a6') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7923b754-a6, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:15 user nova-compute[71347]: INFO os_vif [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:ca:e0,bridge_name='br-int',has_traffic_filtering=True,id=7923b754-a636-4e91-b166-ce9b0c0fce99,network=Network(e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7923b754-a6')
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNgJjElo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[54240f39-58c1-4944-806d-a9898c7a8a7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]: iSNS:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]: STATIC:
Apr 14 14:20:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896
Apr 14 14:20:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:20:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:20:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:15 user nova-compute[71347]: FIRMWARE:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:20:15 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:20:15 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[923787ee-dc30-4447-b535-03658f6e1618]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e479b-9fc3-46f7-9f27-dd7493396818]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:15 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:15 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 (non-flash)
Apr 14 14:20:15 user nova-compute[71347]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:15 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ff839ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c184b44-5ac4-4185-a93f-24ae31304598]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c0e02a-cddc-4a06-a6df-930121a701a9]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd6756c-34e0-4895-943b-bca93703efe3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c15f13-a9b7-4c96-941f-6751805a5f23]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ac01ab-7b2c-44cf-b30b-535b5e576f07]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170db30-9961-4fc5-83eb-dbcbd0660db7]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896, portal: 172.16.0.220,3260]
Apr 14 14:20:15 user nova-compute[71347]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896, portal: 172.16.0.220,3260] successful.
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7122a873-6fa1-4dab-80ba-8ba4d9804896 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dc4886-3150-40e3-9031-32781ad68cd2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== disconnect_volume: return (326ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hIpFjHwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[da511d11-138f-46dc-9149-dbc8834335c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]: iSNS:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]: STATIC:
Apr 14 14:20:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:20:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda
Apr 14 14:20:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:15 user nova-compute[71347]: FIRMWARE:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:20:15 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:20:15 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c0273-1503-40d7-84f8-9d94f2e3bc9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 for instance with vm_state active and task_state deleting.
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-unplugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-cc5e8a3d-7a5f-4cd7-907b-6c91f479b371 for instance with vm_state active and task_state deleting.
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-unplugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-3bfcc6b7-6768-47b7-ae40-f951761442a5 for instance with vm_state active and task_state deleting.
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-unplugged-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-7923b754-a636-4e91-b166-ce9b0c0fce99 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING nova.compute.manager [req-dae99271-66f8-46f9-9be6-16f27f7b3f7d req-33422e10-95d3-4dca-9d80-1585bc97dc09 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-7923b754-a636-4e91-b166-ce9b0c0fce99 for instance with vm_state active and task_state deleting.
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61524db-12fb-4d73-ab6d-0107f919d3c5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:15 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda (non-flash)
Apr 14 14:20:15 user nova-compute[71347]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5007765cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f46e69-4ff3-421c-ab7e-433710216bb2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18deb90-5def-4cc1-b198-a12506f6723a]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b78918-1d46-4426-98ad-4088bd42b7bc]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad71c6-3a53-4800-ad32-7b1a28408dc1]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3737450-b33a-4ec6-8610-c5ea299a6754]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f066ec-86dc-4d1f-ac67-70bf10307469]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda, portal: 172.16.0.220,3260]
Apr 14 14:20:15 user nova-compute[71347]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda, portal: 172.16.0.220,3260] successful.
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c212e76-aa19-4748-8d6a-475e52283dda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b16081-4e4a-46f3-92d8-f233ec33cacb]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== disconnect_volume: return (316ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ebExoRBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ac5d5f-36ec-4b43-a850-919ab9958739]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]: iSNS:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]: STATIC:
Apr 14 14:20:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5
Apr 14 14:20:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:20:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:20:15 user nova-compute[71347]: FIRMWARE:
Apr 14 14:20:15 user nova-compute[71347]: No targets found.
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:20:15 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:20:15 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a85c14f-1a51-49d3-9f03-31d01981b9a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[765f2bc3-158e-47ac-9a75-468a44592d01]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 (non-flash)
Apr 14 14:20:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50077645e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-d6821969-0f10-4fd6-9c25-0a52e658eca6 for instance with vm_state active and task_state deleting.
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-unplugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-unplugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:15 user nova-compute[71347]: WARNING nova.compute.manager [req-de22f2f9-f5b1-4ea4-a74f-164b94fa13c8 req-8fd4d09c-f05f-4b59-aa0e-a954548ff2bd service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-2f7a292d-75de-404e-bb4c-93e2bc9d190b for instance with vm_state active and task_state deleting.
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac52b4d-9cac-4410-a175-14c375dc4351]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[227213b5-1b20-49ad-9944-b38de83afaed]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d1edc-5074-4f8e-89ef-c4ff123fec7d]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:20:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.286s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e91433-9564-4091-b148-6145bdb04957]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.162s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4876c9-029d-4b8b-971a-1d246dc52318]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] Acquiring lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] Lock "56967036-c176-4423-aa3e-c78ee4e364ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] No waiting events found dispatching network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:16 user nova-compute[71347]: WARNING nova.compute.manager [req-c9fb285d-1916-46f3-8c1e-526624981550 req-5c9930c0-6104-4a61-9c9c-c1a63328be56 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received unexpected event network-vif-plugged-e060de39-0ed8-4aa3-9046-222f9254ddfe for instance with vm_state active and task_state deleting.
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[35817193-dfc4-490e-8663-9cc3c4ff85f6]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5, portal: 172.16.0.220,3260]
Apr 14 14:20:16 user nova-compute[71347]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5, portal: 172.16.0.220,3260] successful.
Apr 14 14:20:16 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d2bdcd-ff15-42c4-9750-4cfae1dd90d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166efcc-f269-4ba0-8171-ca3c7f60a160]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.691s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] <== disconnect_volume: return (693ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:20:16 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Deleting instance files /opt/stack/data/nova/instances/56967036-c176-4423-aa3e-c78ee4e364ac_del
Apr 14 14:20:16 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Deletion of /opt/stack/data/nova/instances/56967036-c176-4423-aa3e-c78ee4e364ac_del complete
Apr 14 14:20:16 user nova-compute[71347]: INFO nova.compute.manager [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Took 3.61 seconds to destroy the instance on the hypervisor.
Apr 14 14:20:16 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:20:16 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:20:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:18 user nova-compute[71347]: DEBUG nova.compute.manager [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-deleted-3bfcc6b7-6768-47b7-ae40-f951761442a5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:18 user nova-compute[71347]: INFO nova.compute.manager [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Neutron deleted interface 3bfcc6b7-6768-47b7-ae40-f951761442a5; detaching it from the instance and deleting it from the info cache
Apr 14 14:20:18 user nova-compute[71347]: DEBUG nova.network.neutron [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [{"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "address": "fa:16:3e:46:6e:45", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7a292d-75", "ovs_interfaceid": "2f7a292d-75de-404e-bb4c-93e2bc9d190b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:18 user nova-compute[71347]: DEBUG nova.compute.manager [req-320ecbf7-a8bc-4f17-897f-6359725b8056 req-024a3b0e-e6c1-4581-a451-a640f1f48397 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Detach interface failed, port_id=3bfcc6b7-6768-47b7-ae40-f951761442a5, reason: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:20:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-deleted-2f7a292d-75de-404e-bb4c-93e2bc9d190b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:20 user nova-compute[71347]: INFO nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Neutron deleted interface 2f7a292d-75de-404e-bb4c-93e2bc9d190b; detaching it from the instance and deleting it from the info cache
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.network.neutron [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [{"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "address": "fa:16:3e:1e:f5:b1", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape060de39-0e", "ovs_interfaceid": "e060de39-0ed8-4aa3-9046-222f9254ddfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:20 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Took 3.88 seconds to deallocate network for instance.
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Detach interface failed, port_id=2f7a292d-75de-404e-bb4c-93e2bc9d190b, reason: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-deleted-e060de39-0ed8-4aa3-9046-222f9254ddfe {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:20 user nova-compute[71347]: INFO nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Neutron deleted interface e060de39-0ed8-4aa3-9046-222f9254ddfe; detaching it from the instance and deleting it from the info cache
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.network.neutron [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [{"id": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "address": "fa:16:3e:51:c9:1a", "network": {"id": "5d0243d2-2246-4474-a20b-7456780b2a1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-783279526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b29f14f-01", "ovs_interfaceid": "6b29f14f-01b4-49bc-80ff-6e0a062c47a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Detach interface failed, port_id=e060de39-0ed8-4aa3-9046-222f9254ddfe, reason: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-deleted-6b29f14f-01b4-49bc-80ff-6e0a062c47a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:20 user nova-compute[71347]: INFO nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Neutron deleted interface 6b29f14f-01b4-49bc-80ff-6e0a062c47a2; detaching it from the instance and deleting it from the info cache
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.network.neutron [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [{"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7923b754-a636-4e91-b166-ce9b0c0fce99", "address": "fa:16:3e:2a:ca:e0", "network": {"id": "e3f0a1a4-562d-4ddf-888d-7e6b25e66f5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-896468480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7923b754-a6", "ovs_interfaceid": "7923b754-a636-4e91-b166-ce9b0c0fce99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-4c315717-57d0-47e8-9510-c4db986b98af req-39816271-6ca6-456d-8c8d-d9f4785c1432 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Detach interface failed, port_id=6b29f14f-01b4-49bc-80ff-6e0a062c47a2, reason: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:20:22 user nova-compute[71347]: DEBUG nova.compute.manager [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Received event network-vif-deleted-7923b754-a636-4e91-b166-ce9b0c0fce99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:22 user nova-compute[71347]: INFO nova.compute.manager [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Neutron deleted interface 7923b754-a636-4e91-b166-ce9b0c0fce99; detaching it from the instance and deleting it from the info cache
Apr 14 14:20:22 user nova-compute[71347]: DEBUG nova.network.neutron [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Updating instance_info_cache with network_info: [{"id": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "address": "fa:16:3e:3f:56:eb", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc5e8a3d-7a", "ovs_interfaceid": "cc5e8a3d-7a5f-4cd7-907b-6c91f479b371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "address": "fa:16:3e:30:a0:1b", "network": {"id": "d7cfa24f-ac75-41ae-a03c-aadea36f3fc5", "bridge": "br-int", "label": "tempest-device-tagging-net1-1843414357", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1da7ba7bdb124c3880e3394d3bbab296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6821969-0f", "ovs_interfaceid": "d6821969-0f10-4fd6-9c25-0a52e658eca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:22 user nova-compute[71347]: DEBUG nova.compute.manager [req-799f9f0f-8852-46e0-9ec5-d3c60f963e1d req-8c36b328-face-4510-8a18-cee6d08e38e9 service nova] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Detach interface failed, port_id=7923b754-a636-4e91-b166-ce9b0c0fce99, reason: Instance 56967036-c176-4423-aa3e-c78ee4e364ac could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:20:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:23 user nova-compute[71347]: INFO nova.compute.manager [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Took 3.31 seconds to detach 3 volumes for instance.
Apr 14 14:20:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:24 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:20:24 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:20:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:24 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Deleted allocations for instance 56967036-c176-4423-aa3e-c78ee4e364ac
Apr 14 14:20:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e9d4715f-e2ca-47ac-9298-f5aa66bb414b tempest-TaggedBootDevicesTest_v242-1582702370 tempest-TaggedBootDevicesTest_v242-1582702370-project-member] Lock "56967036-c176-4423-aa3e-c78ee4e364ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.366s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:29 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482014.8310285, 56967036-c176-4423-aa3e-c78ee4e364ac => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:20:29 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] VM Stopped (Lifecycle Event)
Apr 14 14:20:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-687f6c4b-d197-426d-8bde-bc69886e3f15 None None] [instance: 56967036-c176-4423-aa3e-c78ee4e364ac] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:20:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:20:32 user nova-compute[71347]: INFO nova.compute.claims [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Claim successful on node user
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:20:32 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.policy [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5c31630bdcb497da65f928490c26948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21be0383ba4cab992ec2b897e763f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:20:32 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Creating image(s)
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "/opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "/opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "/opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk 1073741824" returned: 0 in 0.047s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Cannot resize image /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'migration_context' on Instance uuid c15d8ed4-3a4b-4c28-be6a-c311b72ecaae {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Ensure instance console log exists: /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:33 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Successfully created port: fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:20:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Successfully updated port: fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "refresh_cache-c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquired lock "refresh_cache-c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG nova.compute.manager [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received event network-changed-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG nova.compute.manager [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Refreshing instance network info cache due to event network-changed-fce52d8f-41dd-4cce-a3cf-d66cffdbc978. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] Acquiring lock "refresh_cache-c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:20:35 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Updating instance_info_cache with network_info: [{"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Releasing lock "refresh_cache-c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Instance network_info: |[{"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] Acquired lock "refresh_cache-c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.network.neutron [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Refreshing network info cache for port fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Start _get_guest_xml network_info=[{"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:20:36 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:20:36 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-221621999',display_name='tempest-VolumesAdminNegativeTest-server-221621999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-221621999',id=14,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa21be0383ba4cab992ec2b897e763f4',ramdisk_id='',reservation_id='r-8qgobptz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1341751798',owner_user_name='tempest-VolumesAdminNegativeTest-1341751798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:20:33Z,user_data=None,user_id='e5c31630bdcb497da65f928490c26948',uuid=c15d8ed4-3a4b-4c28-be6a-c311b72ecaae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converting VIF {"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a8:d0,bridge_name='br-int',has_traffic_filtering=True,id=fce52d8f-41dd-4cce-a3cf-d66cffdbc978,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce52d8f-41') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'pci_devices' on Instance uuid c15d8ed4-3a4b-4c28-be6a-c311b72ecaae {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:20:36 user nova-compute[71347]:   <uuid>c15d8ed4-3a4b-4c28-be6a-c311b72ecaae</uuid>
Apr 14 14:20:36 user nova-compute[71347]:   <name>instance-0000000e</name>
Apr 14 14:20:36 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:20:36 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:20:36 user nova-compute[71347]:   <metadata>
Apr 14 14:20:36 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:20:36 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:20:36 user nova-compute[71347]:       <nova:name>tempest-VolumesAdminNegativeTest-server-221621999</nova:name>
Apr 14 14:20:36 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:20:36</nova:creationTime>
Apr 14 14:20:36 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:20:36 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:20:36 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:20:36 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:20:36 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:20:36 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:20:36 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:20:36 user nova-compute[71347]:       <nova:owner>
Apr 14 14:20:36 user nova-compute[71347]:         <nova:user uuid="e5c31630bdcb497da65f928490c26948">tempest-VolumesAdminNegativeTest-1341751798-project-member</nova:user>
Apr 14 14:20:36 user nova-compute[71347]:         <nova:project uuid="aa21be0383ba4cab992ec2b897e763f4">tempest-VolumesAdminNegativeTest-1341751798</nova:project>
Apr 14 14:20:36 user nova-compute[71347]:       </nova:owner>
Apr 14 14:20:36 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:20:36 user nova-compute[71347]:       <nova:ports>
Apr 14 14:20:36 user nova-compute[71347]:         <nova:port uuid="fce52d8f-41dd-4cce-a3cf-d66cffdbc978">
Apr 14 14:20:36 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 14:20:36 user nova-compute[71347]:         </nova:port>
Apr 14 14:20:36 user nova-compute[71347]:       </nova:ports>
Apr 14 14:20:36 user nova-compute[71347]:     </nova:instance>
Apr 14 14:20:36 user nova-compute[71347]:   </metadata>
Apr 14 14:20:36 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:20:36 user nova-compute[71347]:     <system>
Apr 14 14:20:36 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:20:36 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:20:36 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:20:36 user nova-compute[71347]:       <entry name="serial">c15d8ed4-3a4b-4c28-be6a-c311b72ecaae</entry>
Apr 14 14:20:36 user nova-compute[71347]:       <entry name="uuid">c15d8ed4-3a4b-4c28-be6a-c311b72ecaae</entry>
Apr 14 14:20:36 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:20:36 user nova-compute[71347]:     </system>
Apr 14 14:20:36 user nova-compute[71347]:   </sysinfo>
Apr 14 14:20:36 user nova-compute[71347]:   <os>
Apr 14 14:20:36 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:20:36 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:20:36 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:20:36 user nova-compute[71347]:   </os>
Apr 14 14:20:36 user nova-compute[71347]:   <features>
Apr 14 14:20:36 user nova-compute[71347]:     <acpi/>
Apr 14 14:20:36 user nova-compute[71347]:     <apic/>
Apr 14 14:20:36 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:20:36 user nova-compute[71347]:   </features>
Apr 14 14:20:36 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:20:36 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:20:36 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:20:36 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:20:36 user nova-compute[71347]:   </clock>
Apr 14 14:20:36 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:20:36 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:20:36 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:20:36 user nova-compute[71347]:   </cpu>
Apr 14 14:20:36 user nova-compute[71347]:   <devices>
Apr 14 14:20:36 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:20:36 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:20:36 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk"/>
Apr 14 14:20:36 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:20:36 user nova-compute[71347]:     </disk>
Apr 14 14:20:36 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:20:36 user nova-compute[71347]:       <mac address="fa:16:3e:0a:a8:d0"/>
Apr 14 14:20:36 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:20:36 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:20:36 user nova-compute[71347]:       <target dev="tapfce52d8f-41"/>
Apr 14 14:20:36 user nova-compute[71347]:     </interface>
Apr 14 14:20:36 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:20:36 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/console.log" append="off"/>
Apr 14 14:20:36 user nova-compute[71347]:     </serial>
Apr 14 14:20:36 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:20:36 user nova-compute[71347]:     <video>
Apr 14 14:20:36 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:20:36 user nova-compute[71347]:     </video>
Apr 14 14:20:36 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:20:36 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:20:36 user nova-compute[71347]:     </rng>
Apr 14 14:20:36 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:20:36 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:20:36 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:20:36 user nova-compute[71347]:     </memballoon>
Apr 14 14:20:36 user nova-compute[71347]:   </devices>
Apr 14 14:20:36 user nova-compute[71347]: </domain>
Apr 14 14:20:36 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-221621999',display_name='tempest-VolumesAdminNegativeTest-server-221621999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-221621999',id=14,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa21be0383ba4cab992ec2b897e763f4',ramdisk_id='',reservation_id='r-8qgobptz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1341751798',owner_user_name='tempest-VolumesAdminNegativeTest-1341751798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:20:33Z,user_data=None,user_id='e5c31630bdcb497da65f928490c26948',uuid=c15d8ed4-3a4b-4c28-be6a-c311b72ecaae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converting VIF {"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a8:d0,bridge_name='br-int',has_traffic_filtering=True,id=fce52d8f-41dd-4cce-a3cf-d66cffdbc978,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce52d8f-41') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG os_vif [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a8:d0,bridge_name='br-int',has_traffic_filtering=True,id=fce52d8f-41dd-4cce-a3cf-d66cffdbc978,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce52d8f-41') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfce52d8f-41, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfce52d8f-41, col_values=(('external_ids', {'iface-id': 'fce52d8f-41dd-4cce-a3cf-d66cffdbc978', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:a8:d0', 'vm-uuid': 'c15d8ed4-3a4b-4c28-be6a-c311b72ecaae'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:36 user nova-compute[71347]: INFO os_vif [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a8:d0,bridge_name='br-int',has_traffic_filtering=True,id=fce52d8f-41dd-4cce-a3cf-d66cffdbc978,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce52d8f-41')
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:20:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] No VIF found with MAC fa:16:3e:0a:a8:d0, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:20:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:37 user nova-compute[71347]: DEBUG nova.network.neutron [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Updated VIF entry in instance network info cache for port fce52d8f-41dd-4cce-a3cf-d66cffdbc978. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:20:37 user nova-compute[71347]: DEBUG nova.network.neutron [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Updating instance_info_cache with network_info: [{"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0555bf49-09cd-4ee6-93d6-f71b7f5426b4 req-94bd2d82-6036-4498-8a42-e25e14b53315 service nova] Releasing lock "refresh_cache-c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received event network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] Acquiring lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] No waiting events found dispatching network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:38 user nova-compute[71347]: WARNING nova.compute.manager [req-9f35f82b-c832-4fd6-a37c-3bf68aa2c3d0 req-9246628a-7a27-409c-8593-213a7a3c6dd4 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received unexpected event network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance with vm_state building and task_state spawning.
Apr 14 14:20:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482040.6542883, c15d8ed4-3a4b-4c28-be6a-c311b72ecaae => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:20:40 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] VM Resumed (Lifecycle Event)
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:20:40 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Instance spawned successfully.
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:20:40 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482040.6576073, c15d8ed4-3a4b-4c28-be6a-c311b72ecaae => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:20:40 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] VM Started (Lifecycle Event)
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received event network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] Acquiring lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] No waiting events found dispatching network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:40 user nova-compute[71347]: WARNING nova.compute.manager [req-4aa5d0ff-4992-41c7-946d-57e2ecebb2b5 req-90813eec-d854-4c42-9c09-1c9e63bfdba1 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received unexpected event network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance with vm_state building and task_state spawning.
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:20:40 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:20:40 user nova-compute[71347]: INFO nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Took 7.86 seconds to spawn the instance on the hypervisor.
Apr 14 14:20:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:20:40 user nova-compute[71347]: INFO nova.compute.manager [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Took 8.56 seconds to build instance.
Apr 14 14:20:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3a3f414-5720-426d-8066-4a5e05336dd6 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.664s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:45 user nova-compute[71347]: INFO nova.compute.manager [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Terminating instance
Apr 14 14:20:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-unplugged-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] No waiting events found dispatching network-vif-unplugged-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-858d0c60-2a18-45d9-b5be-f77513ea59d2 req-32ce034b-63dd-4f8d-b24e-f4cd89a38352 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-unplugged-93ca09be-6bf7-49fb-873a-b3236618a784 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Instance destroyed successfully.
Apr 14 14:20:46 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lazy-loading 'resources' on Instance uuid dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1619832572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1619832572',id=11,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSVjfMK4IYnhb5x0HeCFjb8S3VylBFeuF92/8txmAshqKDB23BL3Cxs6dJIgR42kFj+H6bWHbyMQLWBqvziyonVLZOValQVBrNot1O9/FeoYiedDfriEvHSWjaTES6JCQ==',key_name='tempest-keypair-1679569523',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6bca3db8fa34f948a25621d348995f4',ramdisk_id='',reservation_id='r-tggjlwbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-804560801',owner_user_name='tempest-TaggedAttachmentsTest-804560801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec166aaa170041c1a486379c7f417e66',uuid=dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converting VIF {"id": "93ca09be-6bf7-49fb-873a-b3236618a784", "address": "fa:16:3e:cf:76:28", "network": {"id": "241db769-30f2-408d-80e1-f7bc96865f9a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1689931183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6bca3db8fa34f948a25621d348995f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93ca09be-6b", "ovs_interfaceid": "93ca09be-6bf7-49fb-873a-b3236618a784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:76:28,bridge_name='br-int',has_traffic_filtering=True,id=93ca09be-6bf7-49fb-873a-b3236618a784,network=Network(241db769-30f2-408d-80e1-f7bc96865f9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ca09be-6b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG os_vif [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:76:28,bridge_name='br-int',has_traffic_filtering=True,id=93ca09be-6bf7-49fb-873a-b3236618a784,network=Network(241db769-30f2-408d-80e1-f7bc96865f9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ca09be-6b') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93ca09be-6b, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:46 user nova-compute[71347]: INFO os_vif [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:76:28,bridge_name='br-int',has_traffic_filtering=True,id=93ca09be-6bf7-49fb-873a-b3236618a784,network=Network(241db769-30f2-408d-80e1-f7bc96865f9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93ca09be-6b')
Apr 14 14:20:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Deleting instance files /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a_del
Apr 14 14:20:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Deletion of /opt/stack/data/nova/instances/dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a_del complete
Apr 14 14:20:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:47 user nova-compute[71347]: INFO nova.compute.manager [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 14 14:20:47 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:20:47 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:20:47 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:20:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:48 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Took 1.07 seconds to deallocate network for instance.
Apr 14 14:20:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-4c952f81-02d7-408f-83b0-c077f764eb8c req-ae9e82b0-a072-4268-8df7-5157d9d7137a service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-deleted-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:48 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Deleted allocations for instance dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a
Apr 14 14:20:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received event network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] Acquiring lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] No waiting events found dispatching network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:48 user nova-compute[71347]: WARNING nova.compute.manager [req-316b1074-44dd-487b-a3ff-806ef5bb8ffe req-46c0f586-de58-409b-929d-23fc30713784 service nova] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Received unexpected event network-vif-plugged-93ca09be-6bf7-49fb-873a-b3236618a784 for instance with vm_state deleted and task_state None.
Apr 14 14:20:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0cf2e207-124e-400f-94b5-1799bc211463 tempest-TaggedAttachmentsTest-804560801 tempest-TaggedAttachmentsTest-804560801-project-member] Lock "dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "f40364b4-9668-45e3-8d72-d6e49ebb0147" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:50 user nova-compute[71347]: INFO nova.compute.manager [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Terminating instance
Apr 14 14:20:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received event network-vif-unplugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] Acquiring lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] No waiting events found dispatching network-vif-unplugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-3e105b89-22cf-4c82-9265-edb97d62069b req-10b53591-c450-477c-ba3a-35c2937946ae service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received event network-vif-unplugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:20:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Instance destroyed successfully.
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lazy-loading 'resources' on Instance uuid f40364b4-9668-45e3-8d72-d6e49ebb0147 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1371872177',display_name='tempest-ServersNegativeTestJSON-server-1371872177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1371872177',id=13,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08dbbd3691924823b98d44b11508019e',ramdisk_id='',reservation_id='r-lhx2dy9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1373448962',owner_user_name='tempest-ServersNegativeTestJSON-1373448962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:19:09Z,user_data=None,user_id='a609ae82102a4ec994823e59f1a37378',uuid=f40364b4-9668-45e3-8d72-d6e49ebb0147,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converting VIF {"id": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "address": "fa:16:3e:b1:f2:5e", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc8cdaa4-b1", "ovs_interfaceid": "dc8cdaa4-b172-48b6-8678-a9d4f56e2af8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=dc8cdaa4-b172-48b6-8678-a9d4f56e2af8,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8cdaa4-b1') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG os_vif [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=dc8cdaa4-b172-48b6-8678-a9d4f56e2af8,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8cdaa4-b1') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc8cdaa4-b1, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:51 user nova-compute[71347]: INFO os_vif [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=dc8cdaa4-b172-48b6-8678-a9d4f56e2af8,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc8cdaa4-b1')
Apr 14 14:20:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Deleting instance files /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147_del
Apr 14 14:20:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Deletion of /opt/stack/data/nova/instances/f40364b4-9668-45e3-8d72-d6e49ebb0147_del complete
Apr 14 14:20:51 user nova-compute[71347]: INFO nova.compute.manager [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 14:20:51 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:51 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Took 0.78 seconds to deallocate network for instance.
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received event network-vif-deleted-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:51 user nova-compute[71347]: INFO nova.compute.manager [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Neutron deleted interface dc8cdaa4-b172-48b6-8678-a9d4f56e2af8; detaching it from the instance and deleting it from the info cache
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-1ca69ea6-e45f-4797-a3e7-da58a61d08a3 req-1217f91a-f7b0-4a10-b507-4b15a9021da5 service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Detach interface failed, port_id=dc8cdaa4-b172-48b6-8678-a9d4f56e2af8, reason: Instance f40364b4-9668-45e3-8d72-d6e49ebb0147 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.111s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:20:52 user nova-compute[71347]: INFO nova.compute.claims [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Claim successful on node user
Apr 14 14:20:52 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Deleted allocations for instance f40364b4-9668-45e3-8d72-d6e49ebb0147
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ac94cd5-9467-4aba-8be2-0504c4f53e92 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:20:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received event network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] Acquiring lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] Lock "f40364b4-9668-45e3-8d72-d6e49ebb0147-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] No waiting events found dispatching network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:52 user nova-compute[71347]: WARNING nova.compute.manager [req-5696d9a4-6778-422d-9131-9ae5620b1017 req-fecb9f2e-47b8-4cf8-afce-8518867b484b service nova] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Received unexpected event network-vif-plugged-dc8cdaa4-b172-48b6-8678-a9d4f56e2af8 for instance with vm_state deleted and task_state None.
Apr 14 14:20:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:20:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Creating image(s)
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "/opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "/opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "/opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "7fb5cfeeec2333bcd5ced758de2b6e857a4caf67" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "7fb5cfeeec2333bcd5ced758de2b6e857a4caf67" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG nova.virt.images [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 2cb83aa4-680b-4b06-9ae7-13ba22013082 was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67.part /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG nova.policy [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67.part /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67.converted" returned: 0 in 0.167s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "7fb5cfeeec2333bcd5ced758de2b6e857a4caf67" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.854s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:53 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 --force-share --output=json" returned: 0 in 0.166s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "7fb5cfeeec2333bcd5ced758de2b6e857a4caf67" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "7fb5cfeeec2333bcd5ced758de2b6e857a4caf67" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67,backing_fmt=raw /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67,backing_fmt=raw /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk 1073741824" returned: 0 in 0.062s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "7fb5cfeeec2333bcd5ced758de2b6e857a4caf67" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Cannot resize image /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'migration_context' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Ensure instance console log exists: /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG nova.network.neutron [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Successfully created port: cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG nova.network.neutron [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Successfully updated port: cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-changed-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing instance network info cache due to event network-changed-cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] Acquiring lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] Acquired lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing network info cache for port cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:20:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fb8111ce-e1c1-4f43-bbe1-66e8e6705b0c req-07fa63d7-b944-4f5d-8340-23a69e7590df service nova] Releasing lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquired lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG nova.network.neutron [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG nova.network.neutron [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:57 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:20:57 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7936MB free_disk=26.660545349121094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.network.neutron [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating instance_info_cache with network_info: [{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Releasing lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance network_info: |[{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Start _get_guest_xml network_info=[{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:20:48Z,direct_url=<?>,disk_format='qcow2',id=2cb83aa4-680b-4b06-9ae7-13ba22013082,min_disk=0,min_ram=0,name='tempest-scenario-img--1675050401',owner='1df398dd4f844286b41ee4948001013a',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:20:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '2cb83aa4-680b-4b06-9ae7-13ba22013082'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance bc70d475-20dd-4859-a6fe-d2d09341799e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 4d417e09-6e54-4cad-91e5-7910ee4e784a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 201765ec-21d3-4a0e-89f0-ece907f350bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:20:57 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:20:57 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:20:48Z,direct_url=<?>,disk_format='qcow2',id=2cb83aa4-680b-4b06-9ae7-13ba22013082,min_disk=0,min_ram=0,name='tempest-scenario-img--1675050401',owner='1df398dd4f844286b41ee4948001013a',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:20:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-482352325',display_name='tempest-TestMinimumBasicScenario-server-482352325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-482352325',id=15,image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCxxTX8m3sMjnQj10SbCLU0c/Ymb1VjMlB32qA7VxA2M07x/CXWwPIkJsT/KA8EBVjTpbWmbxfVPBZXTWP3k4z2LdlrRlImx/6QWiz51uLgrOJ7Bz3Oub23zXIvs42WMg==',key_name='tempest-TestMinimumBasicScenario-2096424138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-3jz3gczk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:20:53Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=201765ec-21d3-4a0e-89f0-ece907f350bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.objects.instance [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'pci_devices' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:20:57 user nova-compute[71347]:   <uuid>201765ec-21d3-4a0e-89f0-ece907f350bf</uuid>
Apr 14 14:20:57 user nova-compute[71347]:   <name>instance-0000000f</name>
Apr 14 14:20:57 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:20:57 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:20:57 user nova-compute[71347]:   <metadata>
Apr 14 14:20:57 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:20:57 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:20:57 user nova-compute[71347]:       <nova:name>tempest-TestMinimumBasicScenario-server-482352325</nova:name>
Apr 14 14:20:57 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:20:57</nova:creationTime>
Apr 14 14:20:57 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:20:57 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:20:57 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:20:57 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:20:57 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:20:57 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:20:57 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:20:57 user nova-compute[71347]:       <nova:owner>
Apr 14 14:20:57 user nova-compute[71347]:         <nova:user uuid="19dad04c158549c39991ea05fca2531d">tempest-TestMinimumBasicScenario-248098662-project-member</nova:user>
Apr 14 14:20:57 user nova-compute[71347]:         <nova:project uuid="1df398dd4f844286b41ee4948001013a">tempest-TestMinimumBasicScenario-248098662</nova:project>
Apr 14 14:20:57 user nova-compute[71347]:       </nova:owner>
Apr 14 14:20:57 user nova-compute[71347]:       <nova:root type="image" uuid="2cb83aa4-680b-4b06-9ae7-13ba22013082"/>
Apr 14 14:20:57 user nova-compute[71347]:       <nova:ports>
Apr 14 14:20:57 user nova-compute[71347]:         <nova:port uuid="cc694601-d879-4214-ac40-2242faaec5bf">
Apr 14 14:20:57 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:20:57 user nova-compute[71347]:         </nova:port>
Apr 14 14:20:57 user nova-compute[71347]:       </nova:ports>
Apr 14 14:20:57 user nova-compute[71347]:     </nova:instance>
Apr 14 14:20:57 user nova-compute[71347]:   </metadata>
Apr 14 14:20:57 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:20:57 user nova-compute[71347]:     <system>
Apr 14 14:20:57 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:20:57 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:20:57 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:20:57 user nova-compute[71347]:       <entry name="serial">201765ec-21d3-4a0e-89f0-ece907f350bf</entry>
Apr 14 14:20:57 user nova-compute[71347]:       <entry name="uuid">201765ec-21d3-4a0e-89f0-ece907f350bf</entry>
Apr 14 14:20:57 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:20:57 user nova-compute[71347]:     </system>
Apr 14 14:20:57 user nova-compute[71347]:   </sysinfo>
Apr 14 14:20:57 user nova-compute[71347]:   <os>
Apr 14 14:20:57 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:20:57 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:20:57 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:20:57 user nova-compute[71347]:   </os>
Apr 14 14:20:57 user nova-compute[71347]:   <features>
Apr 14 14:20:57 user nova-compute[71347]:     <acpi/>
Apr 14 14:20:57 user nova-compute[71347]:     <apic/>
Apr 14 14:20:57 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:20:57 user nova-compute[71347]:   </features>
Apr 14 14:20:57 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:20:57 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:20:57 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:20:57 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:20:57 user nova-compute[71347]:   </clock>
Apr 14 14:20:57 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:20:57 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:20:57 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:20:57 user nova-compute[71347]:   </cpu>
Apr 14 14:20:57 user nova-compute[71347]:   <devices>
Apr 14 14:20:57 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:20:57 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:20:57 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk"/>
Apr 14 14:20:57 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:20:57 user nova-compute[71347]:     </disk>
Apr 14 14:20:57 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:20:57 user nova-compute[71347]:       <mac address="fa:16:3e:4f:47:62"/>
Apr 14 14:20:57 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:20:57 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:20:57 user nova-compute[71347]:       <target dev="tapcc694601-d8"/>
Apr 14 14:20:57 user nova-compute[71347]:     </interface>
Apr 14 14:20:57 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:20:57 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/console.log" append="off"/>
Apr 14 14:20:57 user nova-compute[71347]:     </serial>
Apr 14 14:20:57 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:20:57 user nova-compute[71347]:     <video>
Apr 14 14:20:57 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:20:57 user nova-compute[71347]:     </video>
Apr 14 14:20:57 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:20:57 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:20:57 user nova-compute[71347]:     </rng>
Apr 14 14:20:57 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:20:57 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:20:57 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:20:57 user nova-compute[71347]:     </memballoon>
Apr 14 14:20:57 user nova-compute[71347]:   </devices>
Apr 14 14:20:57 user nova-compute[71347]: </domain>
Apr 14 14:20:57 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-482352325',display_name='tempest-TestMinimumBasicScenario-server-482352325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-482352325',id=15,image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCxxTX8m3sMjnQj10SbCLU0c/Ymb1VjMlB32qA7VxA2M07x/CXWwPIkJsT/KA8EBVjTpbWmbxfVPBZXTWP3k4z2LdlrRlImx/6QWiz51uLgrOJ7Bz3Oub23zXIvs42WMg==',key_name='tempest-TestMinimumBasicScenario-2096424138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-3jz3gczk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:20:53Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=201765ec-21d3-4a0e-89f0-ece907f350bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG os_vif [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc694601-d8, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc694601-d8, col_values=(('external_ids', {'iface-id': 'cc694601-d879-4214-ac40-2242faaec5bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:47:62', 'vm-uuid': '201765ec-21d3-4a0e-89f0-ece907f350bf'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:57 user nova-compute[71347]: INFO os_vif [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8')
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No VIF found with MAC fa:16:3e:4f:47:62, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG nova.compute.manager [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG nova.compute.manager [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] No waiting events found dispatching network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:20:59 user nova-compute[71347]: WARNING nova.compute.manager [req-f49dd1be-cb6d-4e32-9cdc-f25d6f2942c9 req-6e414db6-718d-433d-bd39-becd3db2b141 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received unexpected event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf for instance with vm_state building and task_state spawning.
Apr 14 14:20:59 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG nova.objects.instance [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'flavor' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:20:59 user nova-compute[71347]: INFO nova.compute.manager [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attaching volume fc7bcb89-d102-4f4c-a94f-677aed86e109 to /dev/vdb
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG os_brick.utils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a3373-aa55-447c-be37-bb7e1199d8e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a6891e-2fd4-41df-b546-a27f11499341]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dd5c2d-8ba4-4853-9fde-4715e93299bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[758567b5-ad7a-42aa-a783-14fb77d04bb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:20:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:00 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea83f5f-4375-4b42-be32-8a74b867f249]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG os_brick.utils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating existing volume attachment record: 429800e2-ac62-46a8-8140-f61717d514de {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:00 user nova-compute[71347]: INFO nova.compute.manager [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Terminating instance
Apr 14 14:21:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:21:00 user nova-compute[71347]: INFO nova.compute.claims [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Claim successful on node user
Apr 14 14:21:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received event network-vif-unplugged-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] No waiting events found dispatching network-vif-unplugged-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1b1b668c-bb14-45bc-9d78-75bc9b5c7346 req-f4553ea0-a159-4d3a-b10e-d8d4d378f5b5 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received event network-vif-unplugged-53a43ee4-c532-49fb-b441-84020cd63e8a for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482061.124628, 201765ec-21d3-4a0e-89f0-ece907f350bf => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] VM Resumed (Lifecycle Event)
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance spawned successfully.
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482061.1250684, 201765ec-21d3-4a0e-89f0-ece907f350bf => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] VM Started (Lifecycle Event)
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Instance destroyed successfully.
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.objects.instance [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lazy-loading 'resources' on Instance uuid 4d417e09-6e54-4cad-91e5-7910ee4e784a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] No waiting events found dispatching network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:01 user nova-compute[71347]: WARNING nova.compute.manager [req-fc4878e9-4ec9-4ac3-9b65-45d613a59c07 req-b1e0f4e9-2e82-4a85-b85a-077a778cd3e7 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received unexpected event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf for instance with vm_state building and task_state spawning.
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1181707762',display_name='tempest-TestVolumeSwap-server-1181707762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1181707762',id=9,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUHjZA/lLKTL8AYeb4MKZeMNC7337OmlBs6hgJc5vFrxuDLxwaaWgDr+nofdCoAuOjgQLOS5xfkD17Ozje4oKBUcPsZO+KEmoUYKmHrqoxiWCDi8m4XdobKcM0hp08pXg==',key_name='tempest-keypair-557766472',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aab9855c5aa444fb8c1636fda0b2f394',ramdisk_id='',reservation_id='r-u57onffj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-306457705',owner_user_name='tempest-TestVolumeSwap-306457705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d54c4c3585e74670adcb025cf9331844',uuid=4d417e09-6e54-4cad-91e5-7910ee4e784a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Converting VIF {"id": "53a43ee4-c532-49fb-b441-84020cd63e8a", "address": "fa:16:3e:2e:88:dd", "network": {"id": "02d90be5-47ba-45f5-b49d-60de28b6639c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-87269084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aab9855c5aa444fb8c1636fda0b2f394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a43ee4-c5", "ovs_interfaceid": "53a43ee4-c532-49fb-b441-84020cd63e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:88:dd,bridge_name='br-int',has_traffic_filtering=True,id=53a43ee4-c532-49fb-b441-84020cd63e8a,network=Network(02d90be5-47ba-45f5-b49d-60de28b6639c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a43ee4-c5') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG os_vif [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:88:dd,bridge_name='br-int',has_traffic_filtering=True,id=53a43ee4-c532-49fb-b441-84020cd63e8a,network=Network(02d90be5-47ba-45f5-b49d-60de28b6639c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a43ee4-c5') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53a43ee4-c5, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:01 user nova-compute[71347]: INFO os_vif [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:88:dd,bridge_name='br-int',has_traffic_filtering=True,id=53a43ee4-c532-49fb-b441-84020cd63e8a,network=Network(02d90be5-47ba-45f5-b49d-60de28b6639c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a43ee4-c5')
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Deleting instance files /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a_del
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Deletion of /opt/stack/data/nova/instances/4d417e09-6e54-4cad-91e5-7910ee4e784a_del complete
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Took 8.31 seconds to spawn the instance on the hypervisor.
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.compute.manager [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.compute.manager [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Took 9.27 seconds to build instance.
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d8faa04-68ae-4aa5-a228-c3cd30f12b44 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.375s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.virt.block_device [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Booting with volume 0cdacc83-d836-4efd-8100-713d62776570 at /dev/vda
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.policy [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bf24630a76646a5b12bec32478b1325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5faf23277b174ab3aee69e7367a22285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG os_brick.utils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3325b331-ab21-4fdb-950d-eb461c9f73d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c10a6c-10f4-4393-b729-7dd9f10ad489]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8324923f-8175-4bd4-9b76-f472bfa1ec44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7866b736-ce09-4c70-9cf4-a14cb8065b93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:01 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[159f6e53-2cfe-44c7-a206-45224d5ccce4]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG os_brick.utils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating existing volume attachment record: c6dcb1a5-0c0d-4c44-a5cf-ab2e2ef467e1 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482046.8564792, dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:01 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] VM Stopped (Lifecycle Event)
Apr 14 14:21:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:21:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-346e564c-d455-4640-817e-aa4ed247e0c8 None None] [instance: dcb039b9-430e-4f6d-b1dd-7a9ad4986a1a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:02 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Took 1.08 seconds to deallocate network for instance.
Apr 14 14:21:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully created port: 5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:02 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Deleted allocations for instance 4d417e09-6e54-4cad-91e5-7910ee4e784a
Apr 14 14:21:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received event network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Acquiring lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] No waiting events found dispatching network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:02 user nova-compute[71347]: WARNING nova.compute.manager [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received unexpected event network-vif-plugged-53a43ee4-c532-49fb-b441-84020cd63e8a for instance with vm_state deleted and task_state None.
Apr 14 14:21:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-0099759e-66d0-4a47-91ce-17fed6b68453 req-a21fcc5c-65e6-46f7-acd7-5f53dc3cffe0 service nova] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Received event network-vif-deleted-53a43ee4-c532-49fb-b441-84020cd63e8a {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5e1cc03-c0a3-4d16-b7bc-3a740d33d949 tempest-TestVolumeSwap-306457705 tempest-TestVolumeSwap-306457705-project-member] Lock "4d417e09-6e54-4cad-91e5-7910ee4e784a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.680s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:03 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully created port: 5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:21:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully created port: 441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdaIglY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:05 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:05 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:05 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f81556-cd0c-4b0c-a6d9-f935a26c4dca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:21:05 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b9421f-0338-4010-aea3-788eacc8b1ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109] added
Apr 14 14:21:05 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b3b9b-4e16-453a-a6e4-eba6a63b1166]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[648e5a4b-0c8b-47d1-b19a-171e308a1901]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqdaIglY {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqdaIglY" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9786d004-d455-4214-b67e-0ca9d6087854]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PqdaIglY'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f9acc6-20ee-45ef-8642-259f7b4a5e24]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4985cdab-209e-4c88-8a98-dffdb812917e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:21:05 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:21:05 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:05 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:21:05 user nova-compute[71347]: 
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb1be2a-c36f-4948-9456-6aada0eb5cfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260]
Apr 14 14:21:05 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260] successful.
Apr 14 14:21:05 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cae855b-18d9-4710-af98-d127323c06ae]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8881052-e614-4008-a138-7811f9c83a1d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:05 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:05 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e045253a-d0d2-4952-9b38-cff18942438d]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:21:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdaIglY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482051.0127366, f40364b4-9668-45e3-8d72-d6e49ebb0147 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:06 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] VM Stopped (Lifecycle Event)
Apr 14 14:21:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-15fc3161-40de-4e87-a1a3-6439b77c4e53 None None] [instance: f40364b4-9668-45e3-8d72-d6e49ebb0147] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully created port: 4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26164376238383364', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164376238383364', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG nova.objects.instance [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'flavor' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:21:06 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:21:06 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:21:06 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:21:06 user nova-compute[71347]:   <serial>fc7bcb89-d102-4f4c-a94f-677aed86e109</serial>
Apr 14 14:21:06 user nova-compute[71347]: </disk>
Apr 14 14:21:06 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:21:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:06 user nova-compute[71347]: INFO nova.virt.block_device [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Booting with volume 3eeadcfc-c90f-42a8-ac27-59c55a64e640 at /dev/vdb
Apr 14 14:21:07 user nova-compute[71347]: DEBUG os_brick.utils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0cfdc3-81d0-49e8-bd9a-0a1224ac25c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[94175010-74a2-4f30-9483-2389a7406166]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No VIF found with MAC fa:16:3e:32:d4:b0, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[533f808b-12fc-422a-9d1d-c3e97bba850f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489f412-6056-47bf-95a2-3f63054eab47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:07 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e2f23-2322-46a2-9f35-85c5cfefa2fd]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG os_brick.utils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating existing volume attachment record: 2a899858-c2b5-4870-8e7c-e7b411a72f74 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-512bc7cb-24e6-4b62-b029-2c9abb1dc653 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.489s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:08 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully created port: 70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:21:08 user nova-compute[71347]: INFO nova.compute.manager [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Rebuilding instance
Apr 14 14:21:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'trusted_certs' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_requests' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_devices' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'resources' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'migration_context' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71347) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully updated port: 5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:09 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance destroyed successfully.
Apr 14 14:21:09 user nova-compute[71347]: DEBUG nova.compute.manager [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-changed-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG nova.compute.manager [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing instance network info cache due to event network-changed-5c8947cd-1a82-4092-bb65-17dcd80ec71e. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG nova.network.neutron [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing network info cache for port 5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG nova.network.neutron [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:09 user nova-compute[71347]: INFO nova.compute.manager [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Detaching volume fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:21:09 user nova-compute[71347]: INFO nova.virt.block_device [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attempting to driver detach volume fc7bcb89-d102-4f4c-a94f-677aed86e109 from mountpoint /dev/vdb
Apr 14 14:21:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Attempting to detach device vdb from instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:21:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:21:09 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:21:09 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:21:09 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:21:09 user nova-compute[71347]:   <serial>fc7bcb89-d102-4f4c-a94f-677aed86e109</serial>
Apr 14 14:21:09 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:21:09 user nova-compute[71347]: </disk>
Apr 14 14:21:09 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:21:10 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully detached device vdb from instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e from the persistent domain config.
Apr 14 14:21:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdaIglY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:10 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370c2ce-c33d-48bb-8ede-8f28c3a851c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:21:10 user nova-compute[71347]: No targets found.
Apr 14 14:21:10 user nova-compute[71347]: iSNS:
Apr 14 14:21:10 user nova-compute[71347]: No targets found.
Apr 14 14:21:10 user nova-compute[71347]: STATIC:
Apr 14 14:21:10 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:21:10 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:21:10 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:21:10 user nova-compute[71347]: FIRMWARE:
Apr 14 14:21:10 user nova-compute[71347]: No targets found.
Apr 14 14:21:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:21:10 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:21:10 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45bdf7d-1103-4420-8c19-22833d050c20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7169582c-6fba-46a3-a92d-468a8ff8eb7e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4f23f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ce580-2771-4a0a-85cb-477dd6eb382d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31b8878-3494-4ad4-bdfb-e29bc840a870]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e413a0-c6a8-416c-bbe3-d63463f3fd4c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2f792-595f-4c06-9c70-ef176f42b466]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ea437-904f-4ba5-b148-f8af819e5f57]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72fee12-f364-4531-9ac2-d856fe028b32]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260]
Apr 14 14:21:10 user nova-compute[71347]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260] successful.
Apr 14 14:21:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f3d245-931d-4840-b4b5-e6f2059a8154]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== disconnect_volume: return (344ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG nova.network.neutron [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-31d84454-8ecf-4e45-bfc9-f11727f09e19 req-276526c1-6a87-4159-a832-834b2986db9e service nova] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully updated port: a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:21:11 user nova-compute[71347]: INFO nova.compute.claims [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Claim successful on node user
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:11 user nova-compute[71347]: INFO nova.compute.manager [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Unshelving
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:11 user nova-compute[71347]: WARNING nova.compute.manager [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state rebuilding.
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:11 user nova-compute[71347]: WARNING nova.compute.manager [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state rebuilding.
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-changed-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing instance network info cache due to event network-changed-a5f92228-fbae-4d8e-8663-327bff5c0992. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing network info cache for port a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:11 user nova-compute[71347]: INFO nova.virt.block_device [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Booting with volume 056480e9-af67-44cc-962d-bff93d69382d at /dev/vdc
Apr 14 14:21:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG os_brick.utils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[28495172-d430-4b6d-85fd-83749cd9917e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e36f837-fa1b-4ab3-a69d-a509f67799e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9d8e2a-ba01-449d-9265-467329721545]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9358c807-2804-418a-a59f-e0ebba6d6030]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:12 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b6c49-b474-497c-95f3-25e8e7f8f441]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG os_brick.utils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating existing volume attachment record: 19123d84-22ce-42ad-9020-83529eeb75c4 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.network.neutron [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77d43cb0-7f08-4109-84fb-aa690e7dea80 req-4f0bcde2-8041-4c46-8862-c5ecda0c6216 service nova] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:21:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.policy [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:21:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Creating image(s)
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "/opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "/opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "/opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully updated port: bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk 1073741824" returned: 0 in 0.089s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance destroyed successfully.
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_vif [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eb1d71a-d0, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:13 user nova-compute[71347]: INFO os_vif [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0')
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdaIglY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:13 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2beb3ec7-d7db-4a12-99ed-7c6f196130a7]: Unexpected error while running command.
Apr 14 14:21:13 user nova-compute[71347]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 14:21:13 user nova-compute[71347]: Exit code: 21
Apr 14 14:21:13 user nova-compute[71347]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 14:21:13 user nova-compute[71347]: Stderr: '' {{(pid=82022) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 14:21:13 user nova-compute[71347]: Traceback (most recent call last):
Apr 14 14:21:13 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 14:21:13 user nova-compute[71347]:     ret = func(*f_args, **f_kwargs)
Apr 14 14:21:13 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 14:21:13 user nova-compute[71347]:     return func(*args, **kwargs)
Apr 14 14:21:13 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 14:21:13 user nova-compute[71347]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 14:21:13 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 14:21:13 user nova-compute[71347]:     return putils.execute(on_execute=on_execute,
Apr 14 14:21:13 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 14:21:13 user nova-compute[71347]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 14:21:13 user nova-compute[71347]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 14:21:13 user nova-compute[71347]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 14:21:13 user nova-compute[71347]: Exit code: 21
Apr 14 14:21:13 user nova-compute[71347]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 14:21:13 user nova-compute[71347]: Stderr: ''
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beb3ec7-d7db-4a12-99ed-7c6f196130a7]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 14:21:13 user nova-compute[71347]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 14:21:13 user nova-compute[71347]: Exit code: 21
Apr 14 14:21:13 user nova-compute[71347]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 14:21:13 user nova-compute[71347]: Stderr: ''
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4084, in _do_rebuild_instance
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 14:21:13 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71347) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== disconnect_volume: return (43ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:21:13 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Deleting instance files /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e_del
Apr 14 14:21:13 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Deletion of /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e_del complete
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Cannot resize image /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'migration_context' on Instance uuid fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Ensure instance console log exists: /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:13 user nova-compute[71347]: INFO nova.virt.block_device [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Booting with volume fc7bcb89-d102-4f4c-a94f-677aed86e109 at /dev/vdb
Apr 14 14:21:13 user nova-compute[71347]: INFO nova.virt.block_device [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Booting with volume 7402d269-0492-44df-b3b6-44553ce0eb8d at /dev/vdc
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.utils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cc2779-8355-48df-be53-bed930364b2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.utils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec10577-7132-4a3f-986f-d51aa6b63a2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d71da-45ae-4ad1-b50b-25f2821ee2f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd7bb0e-4338-4d4c-bf08-47bcbf009d42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully updated port: 5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e5a2e3-b2ed-4e02-ab1a-b04ee46b0fae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2059653b-8db3-4512-ad32-1f34f4c76031]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6ea89e-af14-4d8f-aee9-32f49643d31b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:13 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d643eafc-1c8d-48a9-b94a-7b031cc22ccf]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.utils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating existing volume attachment record: a87a7a13-6939-47e7-8e26-cf6d4d5067de {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d97fb2-8955-463a-8bab-ce4efce8d084]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Successfully created port: b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:21:13 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d842eb-b8ab-4420-a97f-e6a90e90adbf]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG os_brick.utils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== get_connector_properties: return (224ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating existing volume attachment record: 6b56fe51-b941-4242-a71b-5919a2b3fab6 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-changed-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing instance network info cache due to event network-changed-bb36f103-c9d3-48be-b171-19ad5e290b03. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:13 user nova-compute[71347]: DEBUG nova.network.neutron [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing network info cache for port bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-changed-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing instance network info cache due to event network-changed-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing network info cache for port 5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully updated port: 441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Successfully updated port: b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquired lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-299ae4ee-6f2b-4de6-8a4f-fa9ff5d8a402 req-f338d4c6-dc57-4957-a8cf-cef07869b7b6 service nova] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received event network-changed-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Refreshing instance network info cache due to event network-changed-b3956c03-e69e-4181-940f-8e9e890b36ad. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] Acquiring lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Updating instance_info_cache with network_info: [{"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Releasing lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Instance network_info: |[{"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] Acquired lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Refreshing network info cache for port b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Start _get_guest_xml network_info=[{"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:21:15 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:15 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-136108581',display_name='tempest-AttachVolumeNegativeTest-server-136108581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-136108581',id=17,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXMBsx3tZ/pzA7pUesoxz20+s2PMIuu1p4YtORcW2KZpbK+XTk1V1E55dx88s1tlWtpe92mIcpEdZncR+F3HkdmfxQm3HyfeSnI5mqOcypLulfxZXvv2e/JzrsDckWZQA==',key_name='tempest-keypair-1691574866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-ap5z90tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=fafce4d3-18c4-4f15-af62-e599c7749efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:38:67,bridge_name='br-int',has_traffic_filtering=True,id=b3956c03-e69e-4181-940f-8e9e890b36ad,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3956c03-e6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'pci_devices' on Instance uuid fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:21:15 user nova-compute[71347]:   <uuid>fafce4d3-18c4-4f15-af62-e599c7749efe</uuid>
Apr 14 14:21:15 user nova-compute[71347]:   <name>instance-00000011</name>
Apr 14 14:21:15 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:21:15 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:21:15 user nova-compute[71347]:   <metadata>
Apr 14 14:21:15 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:21:15 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:21:15 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeNegativeTest-server-136108581</nova:name>
Apr 14 14:21:15 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:21:15</nova:creationTime>
Apr 14 14:21:15 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:21:15 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:21:15 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:21:15 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:21:15 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:21:15 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:21:15 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:21:15 user nova-compute[71347]:       <nova:owner>
Apr 14 14:21:15 user nova-compute[71347]:         <nova:user uuid="5db83169bedc4520b5e2a2b595362ec1">tempest-AttachVolumeNegativeTest-134968716-project-member</nova:user>
Apr 14 14:21:15 user nova-compute[71347]:         <nova:project uuid="df56fb88b961464496757a358fd15169">tempest-AttachVolumeNegativeTest-134968716</nova:project>
Apr 14 14:21:15 user nova-compute[71347]:       </nova:owner>
Apr 14 14:21:15 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:21:15 user nova-compute[71347]:       <nova:ports>
Apr 14 14:21:15 user nova-compute[71347]:         <nova:port uuid="b3956c03-e69e-4181-940f-8e9e890b36ad">
Apr 14 14:21:15 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 14:21:15 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:15 user nova-compute[71347]:       </nova:ports>
Apr 14 14:21:15 user nova-compute[71347]:     </nova:instance>
Apr 14 14:21:15 user nova-compute[71347]:   </metadata>
Apr 14 14:21:15 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:21:15 user nova-compute[71347]:     <system>
Apr 14 14:21:15 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:21:15 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:21:15 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:21:15 user nova-compute[71347]:       <entry name="serial">fafce4d3-18c4-4f15-af62-e599c7749efe</entry>
Apr 14 14:21:15 user nova-compute[71347]:       <entry name="uuid">fafce4d3-18c4-4f15-af62-e599c7749efe</entry>
Apr 14 14:21:15 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:21:15 user nova-compute[71347]:     </system>
Apr 14 14:21:15 user nova-compute[71347]:   </sysinfo>
Apr 14 14:21:15 user nova-compute[71347]:   <os>
Apr 14 14:21:15 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:21:15 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:21:15 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:21:15 user nova-compute[71347]:   </os>
Apr 14 14:21:15 user nova-compute[71347]:   <features>
Apr 14 14:21:15 user nova-compute[71347]:     <acpi/>
Apr 14 14:21:15 user nova-compute[71347]:     <apic/>
Apr 14 14:21:15 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:21:15 user nova-compute[71347]:   </features>
Apr 14 14:21:15 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:21:15 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:21:15 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:21:15 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:21:15 user nova-compute[71347]:   </clock>
Apr 14 14:21:15 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:21:15 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:21:15 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:21:15 user nova-compute[71347]:   </cpu>
Apr 14 14:21:15 user nova-compute[71347]:   <devices>
Apr 14 14:21:15 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:21:15 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:21:15 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk"/>
Apr 14 14:21:15 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:21:15 user nova-compute[71347]:     </disk>
Apr 14 14:21:15 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:15 user nova-compute[71347]:       <mac address="fa:16:3e:05:38:67"/>
Apr 14 14:21:15 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:15 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:15 user nova-compute[71347]:       <target dev="tapb3956c03-e6"/>
Apr 14 14:21:15 user nova-compute[71347]:     </interface>
Apr 14 14:21:15 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:21:15 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/console.log" append="off"/>
Apr 14 14:21:15 user nova-compute[71347]:     </serial>
Apr 14 14:21:15 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:21:15 user nova-compute[71347]:     <video>
Apr 14 14:21:15 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:15 user nova-compute[71347]:     </video>
Apr 14 14:21:15 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:21:15 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:21:15 user nova-compute[71347]:     </rng>
Apr 14 14:21:15 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:21:15 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:21:15 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:21:15 user nova-compute[71347]:     </memballoon>
Apr 14 14:21:15 user nova-compute[71347]:   </devices>
Apr 14 14:21:15 user nova-compute[71347]: </domain>
Apr 14 14:21:15 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-136108581',display_name='tempest-AttachVolumeNegativeTest-server-136108581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-136108581',id=17,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXMBsx3tZ/pzA7pUesoxz20+s2PMIuu1p4YtORcW2KZpbK+XTk1V1E55dx88s1tlWtpe92mIcpEdZncR+F3HkdmfxQm3HyfeSnI5mqOcypLulfxZXvv2e/JzrsDckWZQA==',key_name='tempest-keypair-1691574866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-ap5z90tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=fafce4d3-18c4-4f15-af62-e599c7749efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:38:67,bridge_name='br-int',has_traffic_filtering=True,id=b3956c03-e69e-4181-940f-8e9e890b36ad,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3956c03-e6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG os_vif [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:38:67,bridge_name='br-int',has_traffic_filtering=True,id=b3956c03-e69e-4181-940f-8e9e890b36ad,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3956c03-e6') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3956c03-e6, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3956c03-e6, col_values=(('external_ids', {'iface-id': 'b3956c03-e69e-4181-940f-8e9e890b36ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:38:67', 'vm-uuid': 'fafce4d3-18c4-4f15-af62-e599c7749efe'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:15 user nova-compute[71347]: INFO os_vif [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:38:67,bridge_name='br-int',has_traffic_filtering=True,id=b3956c03-e69e-4181-940f-8e9e890b36ad,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3956c03-e6')
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No VIF found with MAC fa:16:3e:05:38:67, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully updated port: 4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Updated VIF entry in instance network info cache for port b3956c03-e69e-4181-940f-8e9e890b36ad. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Updating instance_info_cache with network_info: [{"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-239d4fa8-4d7d-43e7-8966-c38fdf52e125 req-1cacba76-5c18-4508-a9fb-f9620a472f01 service nova] Releasing lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-changed-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing instance network info cache due to event network-changed-441450e6-f5c3-49e5-a923-8fe63e779f1f. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing network info cache for port 441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.network.neutron [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.network.neutron [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-changed-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing instance network info cache due to event network-changed-4d2eefbe-0a0c-4746-ad92-71766e028a0f. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.network.neutron [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing network info cache for port 4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482061.1566834, 4d417e09-6e54-4cad-91e5-7910ee4e784a => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:16 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] VM Stopped (Lifecycle Event)
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.network.neutron [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Successfully updated port: 70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4a49de24-40e4-49f9-8aa1-5c1124799656 None None] [instance: 4d417e09-6e54-4cad-91e5-7910ee4e784a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.network.neutron [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edf6f984-1c81-4b51-9556-80c25bfd1f3e req-7e8644ee-a341-4907-bed1-42e37e04ba8d service nova] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG nova.compute.manager [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received event network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG nova.compute.manager [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] No waiting events found dispatching network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:17 user nova-compute[71347]: WARNING nova.compute.manager [req-837ca113-e713-4a8d-8aac-b6297448e55b req-53ccb3f4-7aa4-4560-86a6-2bf080573c1d service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received unexpected event network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad for instance with vm_state building and task_state spawning.
Apr 14 14:21:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'pci_requests' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'numa_topology' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:17 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:21:17 user nova-compute[71347]: INFO nova.compute.claims [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Claim successful on node user
Apr 14 14:21:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:18 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:21:18 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:21:18 user nova-compute[71347]: DEBUG nova.compute.manager [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-changed-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:18 user nova-compute[71347]: DEBUG nova.compute.manager [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing instance network info cache due to event network-changed-70dcece2-b0b6-411e-aece-4c6552fb9331. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:18 user nova-compute[71347]: INFO nova.network.neutron [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating port 839834af-8da2-4f1a-84c5-e0469c3679f5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Creating image(s)
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Ensure instance console log exists: /opt/stack/data/nova/instances/ed499196-32c8-4f77-92af-f84ed0a2cd62/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482079.0845232, fafce4d3-18c4-4f15-af62-e599c7749efe => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] VM Resumed (Lifecycle Event)
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Instance spawned successfully.
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482079.0861027, fafce4d3-18c4-4f15-af62-e599c7749efe => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] VM Started (Lifecycle Event)
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquired lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Took 6.73 seconds to spawn the instance on the hypervisor.
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.compute.manager [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Took 7.71 seconds to build instance.
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7995952-6503-41ac-b8dc-bd92e1017276 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.891s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [{"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance network_info: |[{"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.network.neutron [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing network info cache for port 70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Start _get_guest_xml network_info=[{"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZNyMemR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed499196-32c8-4f77-92af-f84ed0a2cd62', 'attached_at': '', 'detached_at': '', 'volume_id': '0cdacc83-d836-4efd-8100-713d62776570', 'serial': '0cdacc83-d836-4efd-8100-713d62776570'}, 'attachment_id': 'c6dcb1a5-0c0d-4c44-a5cf-ab2e2ef467e1', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWkVMUXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed499196-32c8-4f77-92af-f84ed0a2cd62', 'attached_at': '', 'detached_at': '', 'volume_id': '3eeadcfc-c90f-42a8-ac27-59c55a64e640', 'serial': '3eeadcfc-c90f-42a8-ac27-59c55a64e640'}, 'attachment_id': '2a899858-c2b5-4870-8e7c-e7b411a72f74', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNkxVIWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed499196-32c8-4f77-92af-f84ed0a2cd62', 'attached_at': '', 'detached_at': '', 'volume_id': '7402d269-0492-44df-b3b6-44553ce0eb8d', 'serial': '7402d269-0492-44df-b3b6-44553ce0eb8d'}, 'attachment_id': '6b56fe51-b941-4242-a71b-5919a2b3fab6', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:21:19 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:19 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZNyMemR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:19 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:19 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:19 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received event network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] No waiting events found dispatching network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:19 user nova-compute[71347]: WARNING nova.compute.manager [req-ef6d47c1-8453-4ca4-b647-6b3515e1c6be req-d0439d4f-01f3-4e4f-99ee-557774accef0 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received unexpected event network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad for instance with vm_state active and task_state None.
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb190b00-5f0c-40e6-b5aa-1ca94d5ccc6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:21:19 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34c3d02-d85a-4262-bbf2-cd1f0c811315]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570] added
Apr 14 14:21:19 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Releasing lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:21:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Creating image(s)
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'trusted_certs' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "59f024c375e5245aa1aa64bd540de008e9ddeed6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "59f024c375e5245aa1aa64bd540de008e9ddeed6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.069s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fb881f-25a0-47c0-8a77-d0d83dce1ae0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e4db6c-597e-4586-ba14-903f269c5aae]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZNyMemR {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZNyMemR" returned: 0 in 0.127s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eacdfed-e09e-45fa-ac56-cd8a221ddc71]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-changed-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Refreshing instance network info cache due to event network-changed-839834af-8da2-4f1a-84c5-e0469c3679f5. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] Acquiring lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] Acquired lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG nova.network.neutron [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Refreshing network info cache for port 839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GZNyMemR'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9905889b-4062-42fb-a656-9f887297ef21]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c71a51-aac0-4c87-8305-a760ea4bb665]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:21:20 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:21:20 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:20 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:21:20 user nova-compute[71347]: 
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6.part --force-share --output=json" returned: 0 in 0.215s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG nova.virt.images [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 600bbe0a-7a39-4b51-907c-9612cab2c38e was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6.part /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[060743d8-99fe-40e7-be15-b4ada20a4dbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570, portal: 172.16.0.220,3260]
Apr 14 14:21:20 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570, portal: 172.16.0.220,3260] successful.
Apr 14 14:21:20 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05daed-ae25-4b67-8ef5-8ab5d036e713]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a444a77e-232e-4eb7-b848-2c704ff7aa76]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:20 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:20 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.279s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.048s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7222e2-028b-48f1-bbb5-059d669191b8]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:21:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZNyMemR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG nova.network.neutron [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updated VIF entry in instance network info cache for port 70dcece2-b0b6-411e-aece-4c6552fb9331. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG nova.network.neutron [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [{"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6.part /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6.converted" returned: 0 in 0.253s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cf5fcb19-15b9-4229-a821-f0dec6a5ee6c req-a8291af4-8070-462b-8364-ec7d662d6da5 service nova] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "59f024c375e5245aa1aa64bd540de008e9ddeed6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.499s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6 --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "59f024c375e5245aa1aa64bd540de008e9ddeed6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "59f024c375e5245aa1aa64bd540de008e9ddeed6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG nova.network.neutron [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updated VIF entry in instance network info cache for port 839834af-8da2-4f1a-84c5-e0469c3679f5. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG nova.network.neutron [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-73dba5c1-5047-4eb5-a577-c898275080c8 req-181bb1b3-c874-4a78-96e0-e1a294428028 service nova] Releasing lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6 --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6,backing_fmt=raw /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6,backing_fmt=raw /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk 1073741824" returned: 0 in 0.052s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "59f024c375e5245aa1aa64bd540de008e9ddeed6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6 --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'migration_context' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:21 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Rebasing disk image.
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.174s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d -F raw /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.347s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== connect_volume: return (2351ms) {'type': 'block', 'scsi_wwn': '23332386664363939', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332386664363939', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWkVMUXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:21 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:21 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:21 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:21:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f3a61e-04eb-457d-9ec1-f4b2c31d88ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:21:22 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41a2b6-bd89-497f-a9c5-de8d93fea003]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640] added
Apr 14 14:21:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4dae5d-f6d9-4d95-9f49-aa8760be3675]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bcd517-435e-4182-bd4d-3bc1ee58f0e8]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EWkVMUXv {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EWkVMUXv" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c463b-e046-4af0-a21b-3cc6a355df7a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EWkVMUXv'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d1de4-66a9-47ec-b536-f519a256a2b2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aa7ec7-592d-4b8c-bb18-8f1aedee6e77]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[35536d5b-1cfa-4e44-92e9-cdfa796ed314]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640, portal: 172.16.0.220,3260]
Apr 14 14:21:22 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640, portal: 172.16.0.220,3260] successful.
Apr 14 14:21:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[101e422e-1ea7-457c-80e0-0b575671b7dd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94f14f1-f585-4716-adb7-ebfa5d81188f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:22 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:22 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:21:22 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Creating image(s)
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[46235f00-4b44-441b-ba6b-07e169895583]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWkVMUXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk 1073741824" returned: 0 in 0.198s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:21:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Cannot resize image /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Ensure instance console log exists: /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Start _get_guest_xml network_info=[{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdaIglY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc7bcb89-d102-4f4c-a94f-677aed86e109', 'serial': 'fc7bcb89-d102-4f4c-a94f-677aed86e109'}, 'attachment_id': 'a87a7a13-6939-47e7-8e26-cf6d4d5067de', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:21:23 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 14:21:23 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdaIglY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:23 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23764616263316638', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764616263316638', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.083s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:23 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:23 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNkxVIWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:23 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c0354-7e3e-4f34-b821-27e00fb1e2ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:21:23 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[11afc4fd-30e4-438b-a17f-70e8732a52fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109] added
Apr 14 14:21:23 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e6facd-42ce-4a6c-af9d-20e91a642bff]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[846d6d01-6769-4d87-8864-42ffaf54e9da]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqdaIglY {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqdaIglY" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[076a5795-7ede-459b-8d64-9aeca8241fb1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PqdaIglY'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6654a93c-485b-47a3-93cb-8cc00699e079]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a672a090-d4d1-4ea4-b3de-7f100abe7be6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cc2649-f12d-470c-94dd-dfd19208ad12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260]
Apr 14 14:21:23 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260] successful.
Apr 14 14:21:23 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeda2f13-af88-44f9-b326-ce38b5b46a2c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[938707bc-da70-4280-a07b-171c34bf6872]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:23 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c9d20-bd83-4592-9780-121fabb418ce]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:23 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d -F raw /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk" returned: 0 in 2.632s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Ensure instance console log exists: /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Start _get_guest_xml network_info=[{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a27291f7cd674314b83822868d9b35e9',container_format='bare',created_at=2023-04-14T14:19:19Z,direct_url=<?>,disk_format='qcow2',id=600bbe0a-7a39-4b51-907c-9612cab2c38e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1743182580-shelved',owner='b8263321b4e34ea08350e97ac2a3a794',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T14:19:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NohgiMmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'e81e92d6-b79e-46db-b69e-1f7584440287', 'attached_at': '', 'detached_at': '', 'volume_id': '056480e9-af67-44cc-962d-bff93d69382d', 'serial': '056480e9-af67-44cc-962d-bff93d69382d'}, 'attachment_id': '19123d84-22ce-42ad-9020-83529eeb75c4', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:21:24 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:24 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a27291f7cd674314b83822868d9b35e9',container_format='bare',created_at=2023-04-14T14:19:19Z,direct_url=<?>,disk_format='qcow2',id=600bbe0a-7a39-4b51-907c-9612cab2c38e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1743182580-shelved',owner='b8263321b4e34ea08350e97ac2a3a794',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T14:19:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'vcpu_model' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NohgiMmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:21:24 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdaIglY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26164376238383364', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164376238383364', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.337s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:24 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:24 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482069.696021, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:24 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Stopped (Lifecycle Event)
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed167a2-3846-4113-a6ed-94ba933bd86d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:21:24 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.compute.manager [None req-725c9da6-76db-4e3a-a082-e88fc260c872 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:21:24 user nova-compute[71347]:   <uuid>a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</uuid>
Apr 14 14:21:24 user nova-compute[71347]:   <name>instance-00000005</name>
Apr 14 14:21:24 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:21:24 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:21:24 user nova-compute[71347]:   <metadata>
Apr 14 14:21:24 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:21:24 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:21:24 user nova-compute[71347]:       <nova:name>tempest-ServerActionsTestJSON-server-1012026360</nova:name>
Apr 14 14:21:24 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:21:23</nova:creationTime>
Apr 14 14:21:24 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:21:24 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:21:24 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:21:24 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:21:24 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:21:24 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:21:24 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:21:24 user nova-compute[71347]:       <nova:owner>
Apr 14 14:21:24 user nova-compute[71347]:         <nova:user uuid="797d2d1bff8e4b26afe7856e4c3877cf">tempest-ServerActionsTestJSON-932644409-project-member</nova:user>
Apr 14 14:21:24 user nova-compute[71347]:         <nova:project uuid="3b087f26a80045f3844873220a67a4e4">tempest-ServerActionsTestJSON-932644409</nova:project>
Apr 14 14:21:24 user nova-compute[71347]:       </nova:owner>
Apr 14 14:21:24 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:21:24 user nova-compute[71347]:       <nova:ports>
Apr 14 14:21:24 user nova-compute[71347]:         <nova:port uuid="2eb1d71a-d0d7-473d-9eef-b939fd4b55ef">
Apr 14 14:21:24 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:21:24 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:24 user nova-compute[71347]:       </nova:ports>
Apr 14 14:21:24 user nova-compute[71347]:     </nova:instance>
Apr 14 14:21:24 user nova-compute[71347]:   </metadata>
Apr 14 14:21:24 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:21:24 user nova-compute[71347]:     <system>
Apr 14 14:21:24 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:21:24 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:21:24 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:21:24 user nova-compute[71347]:       <entry name="serial">a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</entry>
Apr 14 14:21:24 user nova-compute[71347]:       <entry name="uuid">a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</entry>
Apr 14 14:21:24 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:21:24 user nova-compute[71347]:     </system>
Apr 14 14:21:24 user nova-compute[71347]:   </sysinfo>
Apr 14 14:21:24 user nova-compute[71347]:   <os>
Apr 14 14:21:24 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:21:24 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:21:24 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:21:24 user nova-compute[71347]:   </os>
Apr 14 14:21:24 user nova-compute[71347]:   <features>
Apr 14 14:21:24 user nova-compute[71347]:     <acpi/>
Apr 14 14:21:24 user nova-compute[71347]:     <apic/>
Apr 14 14:21:24 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:21:24 user nova-compute[71347]:   </features>
Apr 14 14:21:24 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:21:24 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:21:24 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:21:24 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:21:24 user nova-compute[71347]:   </clock>
Apr 14 14:21:24 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:21:24 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:21:24 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:21:24 user nova-compute[71347]:   </cpu>
Apr 14 14:21:24 user nova-compute[71347]:   <devices>
Apr 14 14:21:24 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:21:24 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:21:24 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk"/>
Apr 14 14:21:24 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:21:24 user nova-compute[71347]:     </disk>
Apr 14 14:21:24 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:21:24 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:21:24 user nova-compute[71347]:       <source dev="/dev/sdd"/>
Apr 14 14:21:24 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:21:24 user nova-compute[71347]:       <serial>fc7bcb89-d102-4f4c-a94f-677aed86e109</serial>
Apr 14 14:21:24 user nova-compute[71347]:     </disk>
Apr 14 14:21:24 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:24 user nova-compute[71347]:       <mac address="fa:16:3e:32:d4:b0"/>
Apr 14 14:21:24 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:24 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:24 user nova-compute[71347]:       <target dev="tap2eb1d71a-d0"/>
Apr 14 14:21:24 user nova-compute[71347]:     </interface>
Apr 14 14:21:24 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:21:24 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/console.log" append="off"/>
Apr 14 14:21:24 user nova-compute[71347]:     </serial>
Apr 14 14:21:24 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:21:24 user nova-compute[71347]:     <video>
Apr 14 14:21:24 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:24 user nova-compute[71347]:     </video>
Apr 14 14:21:24 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:21:24 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:21:24 user nova-compute[71347]:     </rng>
Apr 14 14:21:24 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:21:24 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:21:24 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:21:24 user nova-compute[71347]:     </memballoon>
Apr 14 14:21:24 user nova-compute[71347]:   </devices>
Apr 14 14:21:24 user nova-compute[71347]: </domain>
Apr 14 14:21:24 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_vif [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[558fc803-c403-42f0-a46b-b1f87848d5aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d] added
Apr 14 14:21:24 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eb1d71a-d0, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eb1d71a-d0, col_values=(('external_ids', {'iface-id': '2eb1d71a-d0d7-473d-9eef-b939fd4b55ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:d4:b0', 'vm-uuid': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[609bd8cf-3e08-4c77-83c9-329303507f2c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:24 user nova-compute[71347]: INFO os_vif [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0')
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[da12aedd-1bd5-4058-ae56-62096424a2e2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNkxVIWp {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNkxVIWp" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b00a1c-a289-4f07-8c1c-b57c7122cdd1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MNkxVIWp'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No VIF found with MAC fa:16:3e:32:d4:b0, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4862fab-2802-475f-aed2-56edb7a355f5]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7488916c-99d7-4503-829b-531a983cfd71]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:24 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:24 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:24 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:24 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:24 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:24 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c7ce7-a080-4fb6-b09d-e012508ffc7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d, portal: 172.16.0.220,3260]
Apr 14 14:21:24 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d, portal: 172.16.0.220,3260] successful.
Apr 14 14:21:24 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:24 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8876469d-0835-458d-a1ab-e61c6a92c691]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec34371-3b68-4eea-afbb-318cd9b3d45a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:25 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:25 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:25 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:21:25 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:25 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:25 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:25 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:21:25 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[192f0638-b1a8-4b20-a3b6-1c49d8bb1723]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:21:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNkxVIWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== connect_volume: return (2712ms) {'type': 'block', 'scsi_wwn': '26630316466386539', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630316466386539', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.458s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:26 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:21:26 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1971b697-124d-4bae-8fed-e202930ba428]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:21:26 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:af:1f,bridge_name='br-int',has_traffic_filtering=True,id=5c8947cd-1a82-4092-bb65-17dcd80ec71e,network=Network(19bd0998-e23e-41f1-bb89-e2b88e524bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c8947cd-1a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:54:80,bridge_name='br-int',has_traffic_filtering=True,id=a5f92228-fbae-4d8e-8663-327bff5c0992,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5f92228-fb') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=bb36f103-c9d3-48be-b171-19ad5e290b03,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb36f103-c9') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=5e3a95fe-e9ab-42b6-aab1-94b5da13fd90,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3a95fe-e9') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:7f,bridge_name='br-int',has_traffic_filtering=True,id=441450e6-f5c3-49e5-a923-8fe63e779f1f,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441450e6-f5') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d2eefbe-0a0c-4746-ad92-71766e028a0f,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2eefbe-0a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c6:3c,bridge_name='br-int',has_traffic_filtering=True,id=70dcece2-b0b6-411e-aece-4c6552fb9331,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dcece2-b0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.objects.instance [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lazy-loading 'pci_devices' on Instance uuid ed499196-32c8-4f77-92af-f84ed0a2cd62 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ee4a5-bb2a-49c4-8fb4-dede38db00da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d] added
Apr 14 14:21:26 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:21:26 user nova-compute[71347]:   <uuid>ed499196-32c8-4f77-92af-f84ed0a2cd62</uuid>
Apr 14 14:21:26 user nova-compute[71347]:   <name>instance-00000010</name>
Apr 14 14:21:26 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:21:26 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:21:26 user nova-compute[71347]:   <metadata>
Apr 14 14:21:26 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:21:26 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:21:26 user nova-compute[71347]:       <nova:name>tempest-device-tagging-server-190254133</nova:name>
Apr 14 14:21:26 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:21:19</nova:creationTime>
Apr 14 14:21:26 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:21:26 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:21:26 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:21:26 user nova-compute[71347]:       <nova:owner>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:user uuid="0bf24630a76646a5b12bec32478b1325">tempest-TaggedBootDevicesTest-1246501284-project-member</nova:user>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:project uuid="5faf23277b174ab3aee69e7367a22285">tempest-TaggedBootDevicesTest-1246501284</nova:project>
Apr 14 14:21:26 user nova-compute[71347]:       </nova:owner>
Apr 14 14:21:26 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:21:26 user nova-compute[71347]:       <nova:ports>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:port uuid="5c8947cd-1a82-4092-bb65-17dcd80ec71e">
Apr 14 14:21:26 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 14:21:26 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:port uuid="a5f92228-fbae-4d8e-8663-327bff5c0992">
Apr 14 14:21:26 user nova-compute[71347]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Apr 14 14:21:26 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:port uuid="bb36f103-c9d3-48be-b171-19ad5e290b03">
Apr 14 14:21:26 user nova-compute[71347]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Apr 14 14:21:26 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:port uuid="5e3a95fe-e9ab-42b6-aab1-94b5da13fd90">
Apr 14 14:21:26 user nova-compute[71347]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Apr 14 14:21:26 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:port uuid="441450e6-f5c3-49e5-a923-8fe63e779f1f">
Apr 14 14:21:26 user nova-compute[71347]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Apr 14 14:21:26 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:port uuid="4d2eefbe-0a0c-4746-ad92-71766e028a0f">
Apr 14 14:21:26 user nova-compute[71347]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 14:21:26 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:26 user nova-compute[71347]:         <nova:port uuid="70dcece2-b0b6-411e-aece-4c6552fb9331">
Apr 14 14:21:26 user nova-compute[71347]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 14:21:26 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:26 user nova-compute[71347]:       </nova:ports>
Apr 14 14:21:26 user nova-compute[71347]:     </nova:instance>
Apr 14 14:21:26 user nova-compute[71347]:   </metadata>
Apr 14 14:21:26 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:21:26 user nova-compute[71347]:     <system>
Apr 14 14:21:26 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:21:26 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:21:26 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:21:26 user nova-compute[71347]:       <entry name="serial">ed499196-32c8-4f77-92af-f84ed0a2cd62</entry>
Apr 14 14:21:26 user nova-compute[71347]:       <entry name="uuid">ed499196-32c8-4f77-92af-f84ed0a2cd62</entry>
Apr 14 14:21:26 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:21:26 user nova-compute[71347]:     </system>
Apr 14 14:21:26 user nova-compute[71347]:   </sysinfo>
Apr 14 14:21:26 user nova-compute[71347]:   <os>
Apr 14 14:21:26 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:21:26 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:21:26 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:21:26 user nova-compute[71347]:   </os>
Apr 14 14:21:26 user nova-compute[71347]:   <features>
Apr 14 14:21:26 user nova-compute[71347]:     <acpi/>
Apr 14 14:21:26 user nova-compute[71347]:     <apic/>
Apr 14 14:21:26 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:21:26 user nova-compute[71347]:   </features>
Apr 14 14:21:26 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:21:26 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:21:26 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:21:26 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:21:26 user nova-compute[71347]:   </clock>
Apr 14 14:21:26 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:21:26 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:21:26 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:21:26 user nova-compute[71347]:   </cpu>
Apr 14 14:21:26 user nova-compute[71347]:   <devices>
Apr 14 14:21:26 user nova-compute[71347]:     <disk type="file" device="cdrom">
Apr 14 14:21:26 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 14:21:26 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/ed499196-32c8-4f77-92af-f84ed0a2cd62/disk.config"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="hda" bus="ide"/>
Apr 14 14:21:26 user nova-compute[71347]:     </disk>
Apr 14 14:21:26 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:21:26 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:21:26 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <serial>0cdacc83-d836-4efd-8100-713d62776570</serial>
Apr 14 14:21:26 user nova-compute[71347]:     </disk>
Apr 14 14:21:26 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:21:26 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:21:26 user nova-compute[71347]:       <source dev="/dev/sdc"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <serial>3eeadcfc-c90f-42a8-ac27-59c55a64e640</serial>
Apr 14 14:21:26 user nova-compute[71347]:     </disk>
Apr 14 14:21:26 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:21:26 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:21:26 user nova-compute[71347]:       <source dev="/dev/sde"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="vdc" bus="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <serial>7402d269-0492-44df-b3b6-44553ce0eb8d</serial>
Apr 14 14:21:26 user nova-compute[71347]:     </disk>
Apr 14 14:21:26 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:26 user nova-compute[71347]:       <mac address="fa:16:3e:84:af:1f"/>
Apr 14 14:21:26 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="tap5c8947cd-1a"/>
Apr 14 14:21:26 user nova-compute[71347]:     </interface>
Apr 14 14:21:26 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:26 user nova-compute[71347]:       <mac address="fa:16:3e:a1:54:80"/>
Apr 14 14:21:26 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="tapa5f92228-fb"/>
Apr 14 14:21:26 user nova-compute[71347]:     </interface>
Apr 14 14:21:26 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:26 user nova-compute[71347]:       <mac address="fa:16:3e:f2:ea:bd"/>
Apr 14 14:21:26 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="tapbb36f103-c9"/>
Apr 14 14:21:26 user nova-compute[71347]:     </interface>
Apr 14 14:21:26 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:26 user nova-compute[71347]:       <mac address="fa:16:3e:3e:9c:23"/>
Apr 14 14:21:26 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="tap5e3a95fe-e9"/>
Apr 14 14:21:26 user nova-compute[71347]:     </interface>
Apr 14 14:21:26 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:26 user nova-compute[71347]:       <mac address="fa:16:3e:c9:5b:7f"/>
Apr 14 14:21:26 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="tap441450e6-f5"/>
Apr 14 14:21:26 user nova-compute[71347]:     </interface>
Apr 14 14:21:26 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:26 user nova-compute[71347]:       <mac address="fa:16:3e:99:d3:e1"/>
Apr 14 14:21:26 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="tap4d2eefbe-0a"/>
Apr 14 14:21:26 user nova-compute[71347]:     </interface>
Apr 14 14:21:26 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:26 user nova-compute[71347]:       <mac address="fa:16:3e:40:c6:3c"/>
Apr 14 14:21:26 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:26 user nova-compute[71347]:       <target dev="tap70dcece2-b0"/>
Apr 14 14:21:26 user nova-compute[71347]:     </interface>
Apr 14 14:21:26 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:21:26 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/ed499196-32c8-4f77-92af-f84ed0a2cd62/console.log" append="off"/>
Apr 14 14:21:26 user nova-compute[71347]:     </serial>
Apr 14 14:21:26 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:21:26 user nova-compute[71347]:     <video>
Apr 14 14:21:26 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:26 user nova-compute[71347]:     </video>
Apr 14 14:21:26 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:21:26 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:21:26 user nova-compute[71347]:     </rng>
Apr 14 14:21:26 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:21:26 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:21:26 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:21:26 user nova-compute[71347]:     </memballoon>
Apr 14 14:21:26 user nova-compute[71347]:   </devices>
Apr 14 14:21:26 user nova-compute[71347]: </domain>
Apr 14 14:21:26 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:af:1f,bridge_name='br-int',has_traffic_filtering=True,id=5c8947cd-1a82-4092-bb65-17dcd80ec71e,network=Network(19bd0998-e23e-41f1-bb89-e2b88e524bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c8947cd-1a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:af:1f,bridge_name='br-int',has_traffic_filtering=True,id=5c8947cd-1a82-4092-bb65-17dcd80ec71e,network=Network(19bd0998-e23e-41f1-bb89-e2b88e524bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c8947cd-1a') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c8947cd-1a, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c8947cd-1a, col_values=(('external_ids', {'iface-id': '5c8947cd-1a82-4092-bb65-17dcd80ec71e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:af:1f', 'vm-uuid': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15ae34-04e3-4a2e-a5b3-03d328d15746]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: INFO os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:af:1f,bridge_name='br-int',has_traffic_filtering=True,id=5c8947cd-1a82-4092-bb65-17dcd80ec71e,network=Network(19bd0998-e23e-41f1-bb89-e2b88e524bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c8947cd-1a')
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:54:80,bridge_name='br-int',has_traffic_filtering=True,id=a5f92228-fbae-4d8e-8663-327bff5c0992,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5f92228-fb') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:54:80,bridge_name='br-int',has_traffic_filtering=True,id=a5f92228-fbae-4d8e-8663-327bff5c0992,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5f92228-fb') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[120ebbee-d2a1-49da-9d2c-c9be60b92225]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NohgiMmX {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5f92228-fb, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5f92228-fb, col_values=(('external_ids', {'iface-id': 'a5f92228-fbae-4d8e-8663-327bff5c0992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:54:80', 'vm-uuid': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NohgiMmX" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[264c51ed-cae8-4691-8c12-be573253131b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NohgiMmX'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: INFO os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:54:80,bridge_name='br-int',has_traffic_filtering=True,id=a5f92228-fbae-4d8e-8663-327bff5c0992,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5f92228-fb')
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=bb36f103-c9d3-48be-b171-19ad5e290b03,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb36f103-c9') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=bb36f103-c9d3-48be-b171-19ad5e290b03,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb36f103-c9') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb36f103-c9, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb36f103-c9, col_values=(('external_ids', {'iface-id': 'bb36f103-c9d3-48be-b171-19ad5e290b03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:ea:bd', 'vm-uuid': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d24e181-0308-4e88-bb88-06dc357eff92]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7277608-9d7a-437a-9509-682c88588c7c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:21:26 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:21:26 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: INFO os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=bb36f103-c9d3-48be-b171-19ad5e290b03,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb36f103-c9')
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=5e3a95fe-e9ab-42b6-aab1-94b5da13fd90,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3a95fe-e9') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=5e3a95fe-e9ab-42b6-aab1-94b5da13fd90,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3a95fe-e9') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e3a95fe-e9, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e3a95fe-e9, col_values=(('external_ids', {'iface-id': '5e3a95fe-e9ab-42b6-aab1-94b5da13fd90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:9c:23', 'vm-uuid': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: INFO os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=5e3a95fe-e9ab-42b6-aab1-94b5da13fd90,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3a95fe-e9')
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:7f,bridge_name='br-int',has_traffic_filtering=True,id=441450e6-f5c3-49e5-a923-8fe63e779f1f,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441450e6-f5') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:7f,bridge_name='br-int',has_traffic_filtering=True,id=441450e6-f5c3-49e5-a923-8fe63e779f1f,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441450e6-f5') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap441450e6-f5, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap441450e6-f5, col_values=(('external_ids', {'iface-id': '441450e6-f5c3-49e5-a923-8fe63e779f1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:5b:7f', 'vm-uuid': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d1f76-8681-4cea-8173-4e19a51f570d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d, portal: 172.16.0.220,3260]
Apr 14 14:21:26 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d, portal: 172.16.0.220,3260] successful.
Apr 14 14:21:26 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d27df27-ef75-4ec1-94ad-17207e395836]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5278b64-aef0-4406-832f-af02fa424dc5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:21:26 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:21:26 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:21:26 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:21:26 user nova-compute[71347]: INFO os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:7f,bridge_name='br-int',has_traffic_filtering=True,id=441450e6-f5c3-49e5-a923-8fe63e779f1f,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441450e6-f5')
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d2eefbe-0a0c-4746-ad92-71766e028a0f,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2eefbe-0a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d2eefbe-0a0c-4746-ad92-71766e028a0f,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2eefbe-0a') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d2eefbe-0a, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d2eefbe-0a, col_values=(('external_ids', {'iface-id': '4d2eefbe-0a0c-4746-ad92-71766e028a0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:d3:e1', 'vm-uuid': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.092s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9664d575-bdc8-4c08-921e-756301253119]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NohgiMmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: INFO os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d2eefbe-0a0c-4746-ad92-71766e028a0f,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2eefbe-0a')
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c6:3c,bridge_name='br-int',has_traffic_filtering=True,id=70dcece2-b0b6-411e-aece-4c6552fb9331,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dcece2-b0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c6:3c,bridge_name='br-int',has_traffic_filtering=True,id=70dcece2-b0b6-411e-aece-4c6552fb9331,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dcece2-b0') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70dcece2-b0, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70dcece2-b0, col_values=(('external_ids', {'iface-id': '70dcece2-b0b6-411e-aece-4c6552fb9331', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:c6:3c', 'vm-uuid': 'ed499196-32c8-4f77-92af-f84ed0a2cd62'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: INFO os_vif [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c6:3c,bridge_name='br-int',has_traffic_filtering=True,id=70dcece2-b0b6-411e-aece-4c6552fb9331,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dcece2-b0')
Apr 14 14:21:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] No BDM found with device name hda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] No VIF found with MAC fa:16:3e:84:af:1f, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:21:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] No VIF found with MAC fa:16:3e:c9:5b:7f, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:21:26 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Using config drive
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:27 user nova-compute[71347]: WARNING nova.compute.manager [req-663976fb-a9ab-4ec8-8d28-25562c6d0aa2 req-44755745-f57b-4556-9356-0e5a250c2451 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state rebuild_spawning.
Apr 14 14:21:27 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Creating config drive at /opt/stack/data/nova/instances/ed499196-32c8-4f77-92af-f84ed0a2cd62/disk.config
Apr 14 14:21:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ed499196-32c8-4f77-92af-f84ed0a2cd62/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7zi1wbyp {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ed499196-32c8-4f77-92af-f84ed0a2cd62/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7zi1wbyp" returned: 0 in 0.083s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] <== connect_volume: return (2966ms) {'type': 'block', 'scsi_wwn': '23166376266646161', 'path': '/dev/sdf'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166376266646161', 'path': '/dev/sdf'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1743182580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1743182580',id=7,image_ref='600bbe0a-7a39-4b51-907c-9612cab2c38e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-394852903',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-im4193la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member',shelved_at='2023-04-14T14:19:23.260037',shelved_host='user',shelved_image_id='600bbe0a-7a39-4b51-907c-9612cab2c38e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=e81e92d6-b79e-46db-b69e-1f7584440287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'pci_devices' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:21:27 user nova-compute[71347]:   <uuid>e81e92d6-b79e-46db-b69e-1f7584440287</uuid>
Apr 14 14:21:27 user nova-compute[71347]:   <name>instance-00000007</name>
Apr 14 14:21:27 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:21:27 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:21:27 user nova-compute[71347]:   <metadata>
Apr 14 14:21:27 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:21:27 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:21:27 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1743182580</nova:name>
Apr 14 14:21:27 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:21:24</nova:creationTime>
Apr 14 14:21:27 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:21:27 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:21:27 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:21:27 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:21:27 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:21:27 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:21:27 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:21:27 user nova-compute[71347]:       <nova:owner>
Apr 14 14:21:27 user nova-compute[71347]:         <nova:user uuid="a7a99d9a44334bfeb39f6684853f6844">tempest-AttachVolumeShelveTestJSON-1666709251-project-member</nova:user>
Apr 14 14:21:27 user nova-compute[71347]:         <nova:project uuid="b8263321b4e34ea08350e97ac2a3a794">tempest-AttachVolumeShelveTestJSON-1666709251</nova:project>
Apr 14 14:21:27 user nova-compute[71347]:       </nova:owner>
Apr 14 14:21:27 user nova-compute[71347]:       <nova:root type="image" uuid="600bbe0a-7a39-4b51-907c-9612cab2c38e"/>
Apr 14 14:21:27 user nova-compute[71347]:       <nova:ports>
Apr 14 14:21:27 user nova-compute[71347]:         <nova:port uuid="839834af-8da2-4f1a-84c5-e0469c3679f5">
Apr 14 14:21:27 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 14:21:27 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:27 user nova-compute[71347]:       </nova:ports>
Apr 14 14:21:27 user nova-compute[71347]:     </nova:instance>
Apr 14 14:21:27 user nova-compute[71347]:   </metadata>
Apr 14 14:21:27 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:21:27 user nova-compute[71347]:     <system>
Apr 14 14:21:27 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:21:27 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:21:27 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:21:27 user nova-compute[71347]:       <entry name="serial">e81e92d6-b79e-46db-b69e-1f7584440287</entry>
Apr 14 14:21:27 user nova-compute[71347]:       <entry name="uuid">e81e92d6-b79e-46db-b69e-1f7584440287</entry>
Apr 14 14:21:27 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:21:27 user nova-compute[71347]:     </system>
Apr 14 14:21:27 user nova-compute[71347]:   </sysinfo>
Apr 14 14:21:27 user nova-compute[71347]:   <os>
Apr 14 14:21:27 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:21:27 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:21:27 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:21:27 user nova-compute[71347]:   </os>
Apr 14 14:21:27 user nova-compute[71347]:   <features>
Apr 14 14:21:27 user nova-compute[71347]:     <acpi/>
Apr 14 14:21:27 user nova-compute[71347]:     <apic/>
Apr 14 14:21:27 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:21:27 user nova-compute[71347]:   </features>
Apr 14 14:21:27 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:21:27 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:21:27 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:21:27 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:21:27 user nova-compute[71347]:   </clock>
Apr 14 14:21:27 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:21:27 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:21:27 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:21:27 user nova-compute[71347]:   </cpu>
Apr 14 14:21:27 user nova-compute[71347]:   <devices>
Apr 14 14:21:27 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:21:27 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:21:27 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk"/>
Apr 14 14:21:27 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:21:27 user nova-compute[71347]:     </disk>
Apr 14 14:21:27 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:21:27 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:21:27 user nova-compute[71347]:       <source dev="/dev/sdf"/>
Apr 14 14:21:27 user nova-compute[71347]:       <target dev="vdc" bus="virtio"/>
Apr 14 14:21:27 user nova-compute[71347]:       <serial>056480e9-af67-44cc-962d-bff93d69382d</serial>
Apr 14 14:21:27 user nova-compute[71347]:     </disk>
Apr 14 14:21:27 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:27 user nova-compute[71347]:       <mac address="fa:16:3e:c9:08:26"/>
Apr 14 14:21:27 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:27 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:27 user nova-compute[71347]:       <target dev="tap839834af-8d"/>
Apr 14 14:21:27 user nova-compute[71347]:     </interface>
Apr 14 14:21:27 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:21:27 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/console.log" append="off"/>
Apr 14 14:21:27 user nova-compute[71347]:     </serial>
Apr 14 14:21:27 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:21:27 user nova-compute[71347]:     <video>
Apr 14 14:21:27 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:27 user nova-compute[71347]:     </video>
Apr 14 14:21:27 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:21:27 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:21:27 user nova-compute[71347]:     </rng>
Apr 14 14:21:27 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:21:27 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:21:27 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:21:27 user nova-compute[71347]:     </memballoon>
Apr 14 14:21:27 user nova-compute[71347]:   </devices>
Apr 14 14:21:27 user nova-compute[71347]: </domain>
Apr 14 14:21:27 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1743182580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1743182580',id=7,image_ref='600bbe0a-7a39-4b51-907c-9612cab2c38e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-394852903',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-im4193la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member',shelved_at='2023-04-14T14:19:23.260037',shelved_host='user',shelved_image_id='600bbe0a-7a39-4b51-907c-9612cab2c38e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=e81e92d6-b79e-46db-b69e-1f7584440287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG os_vif [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap839834af-8d, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap839834af-8d, col_values=(('external_ids', {'iface-id': '839834af-8da2-4f1a-84c5-e0469c3679f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:08:26', 'vm-uuid': 'e81e92d6-b79e-46db-b69e-1f7584440287'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:27 user nova-compute[71347]: INFO os_vif [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d')
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No VIF found with MAC fa:16:3e:c9:08:26, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482089.2050443, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:29 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Resumed (Lifecycle Event)
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:21:29 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance spawned successfully.
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:29 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482089.2104862, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:29 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Started (Lifecycle Event)
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:29 user nova-compute[71347]: WARNING nova.compute.manager [req-10ffa1e4-3138-4e5e-84e1-9a1b0e5b5691 req-7db90b01-77a8-44cf-aee2-d9eaf5a04901 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state rebuild_spawning.
Apr 14 14:21:29 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71347) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb438e3e-f1e3-48d8-81bf-f90f35d655b9 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:30 user nova-compute[71347]: WARNING nova.compute.manager [req-ce19a47c-d6f7-4355-8d87-bb44661fc49a req-b0fe90b6-bb9d-4fc6-9b9e-5f900fb1b7a1 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance with vm_state building and task_state spawning.
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:31 user nova-compute[71347]: WARNING nova.compute.manager [req-bf8e39bb-12a9-4ca3-9b66-cac5c3ecd734 req-738392d7-aa17-4370-b5fb-f18244e6568e service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 for instance with vm_state building and task_state spawning.
Apr 14 14:21:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:31 user nova-compute[71347]: WARNING nova.compute.manager [req-b8ba3a01-d5fb-425b-a1f9-3905bffaf926 req-65c824e9-8663-40f7-86af-bb4cfd03f633 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 for instance with vm_state building and task_state spawning.
Apr 14 14:21:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:32 user nova-compute[71347]: WARNING nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance with vm_state building and task_state spawning.
Apr 14 14:21:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] No waiting events found dispatching network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:32 user nova-compute[71347]: WARNING nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received unexpected event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 14:21:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] No waiting events found dispatching network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:32 user nova-compute[71347]: WARNING nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received unexpected event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 14:21:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:32 user nova-compute[71347]: WARNING nova.compute.manager [req-e251c128-754d-4dc4-b17b-c8c130655064 req-6610cbff-c4a3-48ad-b697-2c6c2a94bbf8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance with vm_state building and task_state spawning.
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:33 user nova-compute[71347]: WARNING nova.compute.manager [req-86e803e8-d8b9-4c97-9cbb-7f895926134e req-ea208773-cb33-46bd-95ab-4cc5f903ad96 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 for instance with vm_state building and task_state spawning.
Apr 14 14:21:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:33 user nova-compute[71347]: WARNING nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 for instance with vm_state building and task_state spawning.
Apr 14 14:21:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:33 user nova-compute[71347]: WARNING nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f for instance with vm_state building and task_state spawning.
Apr 14 14:21:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:33 user nova-compute[71347]: WARNING nova.compute.manager [req-66524274-d09a-4dca-8d04-b0d4ec235f7e req-e1744e88-3ac8-4338-a785-f691eb882a2f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f for instance with vm_state building and task_state spawning.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482094.356447, e81e92d6-b79e-46db-b69e-1f7584440287 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:34 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] VM Resumed (Lifecycle Event)
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:21:34 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance spawned successfully.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:34 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482094.3604677, e81e92d6-b79e-46db-b69e-1f7584440287 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:34 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] VM Started (Lifecycle Event)
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:34 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:34 user nova-compute[71347]: WARNING nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance with vm_state building and task_state spawning.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:34 user nova-compute[71347]: WARNING nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance with vm_state building and task_state spawning.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:34 user nova-compute[71347]: WARNING nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance with vm_state building and task_state spawning.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:34 user nova-compute[71347]: WARNING nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 for instance with vm_state building and task_state spawning.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:34 user nova-compute[71347]: WARNING nova.compute.manager [req-53dd709f-775c-41ec-9ac4-152f34a11606 req-d49ca7ec-c309-4b5e-bce3-9e446da96ebf service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 for instance with vm_state building and task_state spawning.
Apr 14 14:21:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ffedb8d-4971-48dd-98bd-b012df699114 tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.975s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482096.1010795, ed499196-32c8-4f77-92af-f84ed0a2cd62 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:36 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] VM Resumed (Lifecycle Event)
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:21:36 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance spawned successfully.
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:36 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482096.1078448, ed499196-32c8-4f77-92af-f84ed0a2cd62 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:36 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] VM Started (Lifecycle Event)
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:36 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:36 user nova-compute[71347]: INFO nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Took 17.25 seconds to spawn the instance on the hypervisor.
Apr 14 14:21:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:37 user nova-compute[71347]: INFO nova.compute.manager [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Took 36.19 seconds to build instance.
Apr 14 14:21:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a70b63bc-90c9-48fa-805b-7d8cd8b95040 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.360s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:46 user nova-compute[71347]: INFO nova.compute.manager [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Rescuing
Apr 14 14:21:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquired lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:21:47 user nova-compute[71347]: DEBUG nova.network.neutron [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updating instance_info_cache with network_info: [{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Releasing lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:48 user nova-compute[71347]: WARNING nova.compute.manager [req-e19a4312-95d7-40f2-9961-3fdb8199ef17 req-65452add-bb46-40f6-9e1c-7900d7f81549 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state active and task_state rescuing.
Apr 14 14:21:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:21:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance destroyed successfully.
Apr 14 14:21:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Attempting rescue
Apr 14 14:21:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71347) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance directory exists: not creating {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 14:21:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Creating image(s)
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG nova.objects.instance [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:21:48 user nova-compute[71347]: INFO nova.compute.claims [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Claim successful on node user
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.411s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue" returned: 0 in 0.051s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.466s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'migration_context' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Start _get_guest_xml network_info=[{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:ad:22:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'resources' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'numa_topology' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:49 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:49 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-667599017',display_name='tempest-ServerRescueNegativeTestJSON-server-667599017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-667599017',id=1,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-jq8kt60n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:17:20Z,user_data=None,user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=30643f90-4347-4b1e-b1ca-57e69e716fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:ad:22:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:ad:22:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:22:e9,bridge_name='br-int',has_traffic_filtering=True,id=1a957ddb-f21a-4f08-8309-8c866fd2d6c4,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a957ddb-f2') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'pci_devices' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:21:49 user nova-compute[71347]:   <uuid>30643f90-4347-4b1e-b1ca-57e69e716fb4</uuid>
Apr 14 14:21:49 user nova-compute[71347]:   <name>instance-00000001</name>
Apr 14 14:21:49 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:21:49 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:21:49 user nova-compute[71347]:   <metadata>
Apr 14 14:21:49 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:21:49 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:21:49 user nova-compute[71347]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-667599017</nova:name>
Apr 14 14:21:49 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:21:49</nova:creationTime>
Apr 14 14:21:49 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:21:49 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:21:49 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:21:49 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:21:49 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:21:49 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:21:49 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:21:49 user nova-compute[71347]:       <nova:owner>
Apr 14 14:21:49 user nova-compute[71347]:         <nova:user uuid="cdfcb787b0f545f8b19e947d54d07b9c">tempest-ServerRescueNegativeTestJSON-1435712120-project-member</nova:user>
Apr 14 14:21:49 user nova-compute[71347]:         <nova:project uuid="b53efd997e3e47d898264dae8a27a5ad">tempest-ServerRescueNegativeTestJSON-1435712120</nova:project>
Apr 14 14:21:49 user nova-compute[71347]:       </nova:owner>
Apr 14 14:21:49 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:21:49 user nova-compute[71347]:       <nova:ports>
Apr 14 14:21:49 user nova-compute[71347]:         <nova:port uuid="1a957ddb-f21a-4f08-8309-8c866fd2d6c4">
Apr 14 14:21:49 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 14:21:49 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:49 user nova-compute[71347]:       </nova:ports>
Apr 14 14:21:49 user nova-compute[71347]:     </nova:instance>
Apr 14 14:21:49 user nova-compute[71347]:   </metadata>
Apr 14 14:21:49 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:21:49 user nova-compute[71347]:     <system>
Apr 14 14:21:49 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:21:49 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:21:49 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:21:49 user nova-compute[71347]:       <entry name="serial">30643f90-4347-4b1e-b1ca-57e69e716fb4</entry>
Apr 14 14:21:49 user nova-compute[71347]:       <entry name="uuid">30643f90-4347-4b1e-b1ca-57e69e716fb4</entry>
Apr 14 14:21:49 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:21:49 user nova-compute[71347]:     </system>
Apr 14 14:21:49 user nova-compute[71347]:   </sysinfo>
Apr 14 14:21:49 user nova-compute[71347]:   <os>
Apr 14 14:21:49 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:21:49 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:21:49 user nova-compute[71347]:   </os>
Apr 14 14:21:49 user nova-compute[71347]:   <features>
Apr 14 14:21:49 user nova-compute[71347]:     <acpi/>
Apr 14 14:21:49 user nova-compute[71347]:     <apic/>
Apr 14 14:21:49 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:21:49 user nova-compute[71347]:   </features>
Apr 14 14:21:49 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:21:49 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:21:49 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:21:49 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:21:49 user nova-compute[71347]:   </clock>
Apr 14 14:21:49 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:21:49 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:21:49 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:21:49 user nova-compute[71347]:   </cpu>
Apr 14 14:21:49 user nova-compute[71347]:   <devices>
Apr 14 14:21:49 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:21:49 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:21:49 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue"/>
Apr 14 14:21:49 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:21:49 user nova-compute[71347]:     </disk>
Apr 14 14:21:49 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:21:49 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:21:49 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk"/>
Apr 14 14:21:49 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:21:49 user nova-compute[71347]:     </disk>
Apr 14 14:21:49 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:49 user nova-compute[71347]:       <mac address="fa:16:3e:ad:22:e9"/>
Apr 14 14:21:49 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:49 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:49 user nova-compute[71347]:       <target dev="tap1a957ddb-f2"/>
Apr 14 14:21:49 user nova-compute[71347]:     </interface>
Apr 14 14:21:49 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:21:49 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/console.log" append="off"/>
Apr 14 14:21:49 user nova-compute[71347]:     </serial>
Apr 14 14:21:49 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:21:49 user nova-compute[71347]:     <video>
Apr 14 14:21:49 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:49 user nova-compute[71347]:     </video>
Apr 14 14:21:49 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:21:49 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:21:49 user nova-compute[71347]:     </rng>
Apr 14 14:21:49 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:21:49 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:21:49 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:21:49 user nova-compute[71347]:     </memballoon>
Apr 14 14:21:49 user nova-compute[71347]:   </devices>
Apr 14 14:21:49 user nova-compute[71347]: </domain>
Apr 14 14:21:49 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:21:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance destroyed successfully.
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No VIF found with MAC fa:16:3e:ad:22:e9, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:21:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.policy [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f64d891eb758466888e7ca9550994511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b661ed41a346a487e0b47ce2c2af13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:21:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Creating image(s)
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk 1073741824" returned: 0 in 0.054s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:50 user nova-compute[71347]: WARNING nova.compute.manager [req-a8b2569a-cd1f-47ce-94f0-92a40397dba1 req-b023997d-1870-489d-8ace-e241f8272acb service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state active and task_state rescuing.
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Cannot resize image /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'migration_context' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Ensure instance console log exists: /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Successfully created port: fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:51 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Successfully updated port: fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:21:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquired lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:51 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:21:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-changed-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Refreshing instance network info cache due to event network-changed-fc6a8af0-4a67-4942-9548-41928d3f3f5d. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:21:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] Acquiring lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:21:51 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:52 user nova-compute[71347]: WARNING nova.compute.manager [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state active and task_state rescuing.
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:52 user nova-compute[71347]: WARNING nova.compute.manager [req-7de430fa-1e40-486e-a786-8ac2ddd0e762 req-6d112e66-fc74-466e-b241-a6b732f43316 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state active and task_state rescuing.
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Releasing lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance network_info: |[{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] Acquired lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Refreshing network info cache for port fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Start _get_guest_xml network_info=[{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:21:52 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:52 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-393140121',display_name='tempest-ServerStableDeviceRescueTest-server-393140121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-393140121',id=18,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcG6CGdcPTxnc20cAT09PWltwZ9dV2VmciF9n8/6ntZku9choOWtWjG4TaYyDwwi97Q7GgJIEVXlDOgWGZq3YI+oL07LY/8GN78RAWAGwVdDlzGqza6dkL5xCOnG2giNA==',key_name='tempest-keypair-1665568620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b661ed41a346a487e0b47ce2c2af13',ramdisk_id='',reservation_id='r-usawgxs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-339063849',owner_user_name='tempest-ServerStableDeviceRescueTest-339063849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64d891eb758466888e7ca9550994511',uuid=18a432a7-c206-4cf8-9718-7d5360d97f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Converting VIF {"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:92,bridge_name='br-int',has_traffic_filtering=True,id=fc6a8af0-4a67-4942-9548-41928d3f3f5d,network=Network(eebad641-c9f2-4ff8-8655-6019ac289951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc6a8af0-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'pci_devices' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:21:52 user nova-compute[71347]:   <uuid>18a432a7-c206-4cf8-9718-7d5360d97f4e</uuid>
Apr 14 14:21:52 user nova-compute[71347]:   <name>instance-00000012</name>
Apr 14 14:21:52 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:21:52 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:21:52 user nova-compute[71347]:   <metadata>
Apr 14 14:21:52 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:21:52 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:21:52 user nova-compute[71347]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-393140121</nova:name>
Apr 14 14:21:52 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:21:52</nova:creationTime>
Apr 14 14:21:52 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:21:52 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:21:52 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:21:52 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:21:52 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:21:52 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:21:52 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:21:52 user nova-compute[71347]:       <nova:owner>
Apr 14 14:21:52 user nova-compute[71347]:         <nova:user uuid="f64d891eb758466888e7ca9550994511">tempest-ServerStableDeviceRescueTest-339063849-project-member</nova:user>
Apr 14 14:21:52 user nova-compute[71347]:         <nova:project uuid="08b661ed41a346a487e0b47ce2c2af13">tempest-ServerStableDeviceRescueTest-339063849</nova:project>
Apr 14 14:21:52 user nova-compute[71347]:       </nova:owner>
Apr 14 14:21:52 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:21:52 user nova-compute[71347]:       <nova:ports>
Apr 14 14:21:52 user nova-compute[71347]:         <nova:port uuid="fc6a8af0-4a67-4942-9548-41928d3f3f5d">
Apr 14 14:21:52 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 14:21:52 user nova-compute[71347]:         </nova:port>
Apr 14 14:21:52 user nova-compute[71347]:       </nova:ports>
Apr 14 14:21:52 user nova-compute[71347]:     </nova:instance>
Apr 14 14:21:52 user nova-compute[71347]:   </metadata>
Apr 14 14:21:52 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:21:52 user nova-compute[71347]:     <system>
Apr 14 14:21:52 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:21:52 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:21:52 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:21:52 user nova-compute[71347]:       <entry name="serial">18a432a7-c206-4cf8-9718-7d5360d97f4e</entry>
Apr 14 14:21:52 user nova-compute[71347]:       <entry name="uuid">18a432a7-c206-4cf8-9718-7d5360d97f4e</entry>
Apr 14 14:21:52 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:21:52 user nova-compute[71347]:     </system>
Apr 14 14:21:52 user nova-compute[71347]:   </sysinfo>
Apr 14 14:21:52 user nova-compute[71347]:   <os>
Apr 14 14:21:52 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:21:52 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:21:52 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:21:52 user nova-compute[71347]:   </os>
Apr 14 14:21:52 user nova-compute[71347]:   <features>
Apr 14 14:21:52 user nova-compute[71347]:     <acpi/>
Apr 14 14:21:52 user nova-compute[71347]:     <apic/>
Apr 14 14:21:52 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:21:52 user nova-compute[71347]:   </features>
Apr 14 14:21:52 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:21:52 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:21:52 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:21:52 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:21:52 user nova-compute[71347]:   </clock>
Apr 14 14:21:52 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:21:52 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:21:52 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:21:52 user nova-compute[71347]:   </cpu>
Apr 14 14:21:52 user nova-compute[71347]:   <devices>
Apr 14 14:21:52 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:21:52 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:21:52 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk"/>
Apr 14 14:21:52 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:21:52 user nova-compute[71347]:     </disk>
Apr 14 14:21:52 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:21:52 user nova-compute[71347]:       <mac address="fa:16:3e:22:e2:92"/>
Apr 14 14:21:52 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:52 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:21:52 user nova-compute[71347]:       <target dev="tapfc6a8af0-4a"/>
Apr 14 14:21:52 user nova-compute[71347]:     </interface>
Apr 14 14:21:52 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:21:52 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/console.log" append="off"/>
Apr 14 14:21:52 user nova-compute[71347]:     </serial>
Apr 14 14:21:52 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:21:52 user nova-compute[71347]:     <video>
Apr 14 14:21:52 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:21:52 user nova-compute[71347]:     </video>
Apr 14 14:21:52 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:21:52 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:21:52 user nova-compute[71347]:     </rng>
Apr 14 14:21:52 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:21:52 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:21:52 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:21:52 user nova-compute[71347]:     </memballoon>
Apr 14 14:21:52 user nova-compute[71347]:   </devices>
Apr 14 14:21:52 user nova-compute[71347]: </domain>
Apr 14 14:21:52 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-393140121',display_name='tempest-ServerStableDeviceRescueTest-server-393140121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-393140121',id=18,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcG6CGdcPTxnc20cAT09PWltwZ9dV2VmciF9n8/6ntZku9choOWtWjG4TaYyDwwi97Q7GgJIEVXlDOgWGZq3YI+oL07LY/8GN78RAWAGwVdDlzGqza6dkL5xCOnG2giNA==',key_name='tempest-keypair-1665568620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b661ed41a346a487e0b47ce2c2af13',ramdisk_id='',reservation_id='r-usawgxs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-339063849',owner_user_name='tempest-ServerStableDeviceRescueTest-339063849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64d891eb758466888e7ca9550994511',uuid=18a432a7-c206-4cf8-9718-7d5360d97f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Converting VIF {"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:92,bridge_name='br-int',has_traffic_filtering=True,id=fc6a8af0-4a67-4942-9548-41928d3f3f5d,network=Network(eebad641-c9f2-4ff8-8655-6019ac289951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc6a8af0-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG os_vif [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:92,bridge_name='br-int',has_traffic_filtering=True,id=fc6a8af0-4a67-4942-9548-41928d3f3f5d,network=Network(eebad641-c9f2-4ff8-8655-6019ac289951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc6a8af0-4a') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc6a8af0-4a, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc6a8af0-4a, col_values=(('external_ids', {'iface-id': 'fc6a8af0-4a67-4942-9548-41928d3f3f5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:e2:92', 'vm-uuid': '18a432a7-c206-4cf8-9718-7d5360d97f4e'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:52 user nova-compute[71347]: INFO os_vif [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e2:92,bridge_name='br-int',has_traffic_filtering=True,id=fc6a8af0-4a67-4942-9548-41928d3f3f5d,network=Network(eebad641-c9f2-4ff8-8655-6019ac289951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc6a8af0-4a')
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No VIF found with MAC fa:16:3e:22:e2:92, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updated VIF entry in instance network info cache for port fc6a8af0-4a67-4942-9548-41928d3f3f5d. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:21:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-14278756-ecb7-4725-ac94-f507731ed54e req-07a0d9a0-55dd-4402-baff-ebcf2bbb9cb2 service nova] Releasing lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 30643f90-4347-4b1e-b1ca-57e69e716fb4 due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482113.2292144, 30643f90-4347-4b1e-b1ca-57e69e716fb4 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:53 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] VM Resumed (Lifecycle Event)
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-629ca2ae-6f74-4357-8e8f-30601bb7f5c4 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:53 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482113.3016567, 30643f90-4347-4b1e-b1ca-57e69e716fb4 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:53 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] VM Started (Lifecycle Event)
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:53 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 14:21:53 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:54 user nova-compute[71347]: WARNING nova.compute.manager [req-6bd13258-9617-4811-af9a-5a8d27794b31 req-325f4f69-d0ba-4331-a9f8-d62269647f21 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state building and task_state spawning.
Apr 14 14:21:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:21:56 user nova-compute[71347]: WARNING nova.compute.manager [req-0379c04e-74d8-4d12-8032-8903f59a5964 req-c324bc23-2024-4673-9311-e62bdf06fad6 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state building and task_state spawning.
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482116.429925, 18a432a7-c206-4cf8-9718-7d5360d97f4e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] VM Resumed (Lifecycle Event)
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:21:56 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance spawned successfully.
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:21:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482116.4341059, 18a432a7-c206-4cf8-9718-7d5360d97f4e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:21:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] VM Started (Lifecycle Event)
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:21:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:21:56 user nova-compute[71347]: INFO nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Took 7.05 seconds to spawn the instance on the hypervisor.
Apr 14 14:21:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:56 user nova-compute[71347]: INFO nova.compute.manager [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Took 8.17 seconds to build instance.
Apr 14 14:21:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ebfe2db1-79bc-4b53-9bf8-664dfa66d503 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.340s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:21:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:22:01 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:22:01 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7463MB free_disk=26.594314575195312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance bc70d475-20dd-4859-a6fe-d2d09341799e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 201765ec-21d3-4a0e-89f0-ece907f350bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fafce4d3-18c4-4f15-af62-e599c7749efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e81e92d6-b79e-46db-b69e-1f7584440287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:22:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:22:02 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:22:02 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:22:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:02 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:22:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:04 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:04 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:22:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:22:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:22:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [{"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-e81e92d6-b79e-46db-b69e-1f7584440287" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:22:07 user nova-compute[71347]: INFO nova.compute.claims [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Claim successful on node user
Apr 14 14:22:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:22:07 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG nova.network.neutron [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:22:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:22:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:22:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Creating image(s)
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.032s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG nova.policy [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.174s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk 1073741824" returned: 0 in 0.053s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:22:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Cannot resize image /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG nova.objects.instance [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'migration_context' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Ensure instance console log exists: /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:09 user nova-compute[71347]: DEBUG nova.network.neutron [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Successfully created port: 693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Successfully updated port: 693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquired lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-changed-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Refreshing instance network info cache due to event network-changed-693b3793-ec24-4c90-ba05-73d5e4eaa30f. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] Acquiring lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updating instance_info_cache with network_info: [{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Releasing lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance network_info: |[{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] Acquired lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.neutron [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Refreshing network info cache for port 693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Start _get_guest_xml network_info=[{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:22:10 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:22:10 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.objects.instance [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'pci_devices' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:22:10 user nova-compute[71347]:   <uuid>a3faeeb1-a50c-474b-b694-98c4d70435d5</uuid>
Apr 14 14:22:10 user nova-compute[71347]:   <name>instance-00000013</name>
Apr 14 14:22:10 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:22:10 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:22:10 user nova-compute[71347]:   <metadata>
Apr 14 14:22:10 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:22:10 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:22:10 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeTestJSON-server-398425278</nova:name>
Apr 14 14:22:10 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:22:10</nova:creationTime>
Apr 14 14:22:10 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:22:10 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:22:10 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:22:10 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:22:10 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:22:10 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:22:10 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:22:10 user nova-compute[71347]:       <nova:owner>
Apr 14 14:22:10 user nova-compute[71347]:         <nova:user uuid="303cb0475ae74f328ee503d1e9d1f652">tempest-AttachVolumeTestJSON-1787222284-project-member</nova:user>
Apr 14 14:22:10 user nova-compute[71347]:         <nova:project uuid="6dd9adda27714cf5b55203d8d76de05a">tempest-AttachVolumeTestJSON-1787222284</nova:project>
Apr 14 14:22:10 user nova-compute[71347]:       </nova:owner>
Apr 14 14:22:10 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:22:10 user nova-compute[71347]:       <nova:ports>
Apr 14 14:22:10 user nova-compute[71347]:         <nova:port uuid="693b3793-ec24-4c90-ba05-73d5e4eaa30f">
Apr 14 14:22:10 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 14:22:10 user nova-compute[71347]:         </nova:port>
Apr 14 14:22:10 user nova-compute[71347]:       </nova:ports>
Apr 14 14:22:10 user nova-compute[71347]:     </nova:instance>
Apr 14 14:22:10 user nova-compute[71347]:   </metadata>
Apr 14 14:22:10 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:22:10 user nova-compute[71347]:     <system>
Apr 14 14:22:10 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:22:10 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:22:10 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:22:10 user nova-compute[71347]:       <entry name="serial">a3faeeb1-a50c-474b-b694-98c4d70435d5</entry>
Apr 14 14:22:10 user nova-compute[71347]:       <entry name="uuid">a3faeeb1-a50c-474b-b694-98c4d70435d5</entry>
Apr 14 14:22:10 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:22:10 user nova-compute[71347]:     </system>
Apr 14 14:22:10 user nova-compute[71347]:   </sysinfo>
Apr 14 14:22:10 user nova-compute[71347]:   <os>
Apr 14 14:22:10 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:22:10 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:22:10 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:22:10 user nova-compute[71347]:   </os>
Apr 14 14:22:10 user nova-compute[71347]:   <features>
Apr 14 14:22:10 user nova-compute[71347]:     <acpi/>
Apr 14 14:22:10 user nova-compute[71347]:     <apic/>
Apr 14 14:22:10 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:22:10 user nova-compute[71347]:   </features>
Apr 14 14:22:10 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:22:10 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:22:10 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:22:10 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:22:10 user nova-compute[71347]:   </clock>
Apr 14 14:22:10 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:22:10 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:22:10 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:22:10 user nova-compute[71347]:   </cpu>
Apr 14 14:22:10 user nova-compute[71347]:   <devices>
Apr 14 14:22:10 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:22:10 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:22:10 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk"/>
Apr 14 14:22:10 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:22:10 user nova-compute[71347]:     </disk>
Apr 14 14:22:10 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:22:10 user nova-compute[71347]:       <mac address="fa:16:3e:39:a0:32"/>
Apr 14 14:22:10 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:22:10 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:22:10 user nova-compute[71347]:       <target dev="tap693b3793-ec"/>
Apr 14 14:22:10 user nova-compute[71347]:     </interface>
Apr 14 14:22:10 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:22:10 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/console.log" append="off"/>
Apr 14 14:22:10 user nova-compute[71347]:     </serial>
Apr 14 14:22:10 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:22:10 user nova-compute[71347]:     <video>
Apr 14 14:22:10 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:22:10 user nova-compute[71347]:     </video>
Apr 14 14:22:10 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:22:10 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:22:10 user nova-compute[71347]:     </rng>
Apr 14 14:22:10 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:22:10 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:22:10 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:22:10 user nova-compute[71347]:     </memballoon>
Apr 14 14:22:10 user nova-compute[71347]:   </devices>
Apr 14 14:22:10 user nova-compute[71347]: </domain>
Apr 14 14:22:10 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG os_vif [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap693b3793-ec, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap693b3793-ec, col_values=(('external_ids', {'iface-id': '693b3793-ec24-4c90-ba05-73d5e4eaa30f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:a0:32', 'vm-uuid': 'a3faeeb1-a50c-474b-b694-98c4d70435d5'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:22:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:10 user nova-compute[71347]: INFO os_vif [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec')
Apr 14 14:22:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:22:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No VIF found with MAC fa:16:3e:39:a0:32, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:22:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updated VIF entry in instance network info cache for port 693b3793-ec24-4c90-ba05-73d5e4eaa30f. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:22:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updating instance_info_cache with network_info: [{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:22:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8d9d2955-b625-4050-b5fe-735415acdbba req-398d4dff-aa45-4632-a1ae-5ac1d4a5aa8c service nova] Releasing lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:12 user nova-compute[71347]: WARNING nova.compute.manager [req-22ff792f-2925-49ef-bca9-cb0fea97b304 req-36c03728-1aac-4643-97c3-1a1fb915b70e service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state building and task_state spawning.
Apr 14 14:22:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482134.4886923, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:22:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Resumed (Lifecycle Event)
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:22:14 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance spawned successfully.
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:22:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482134.49226, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:22:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Started (Lifecycle Event)
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:22:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:22:14 user nova-compute[71347]: INFO nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Took 6.29 seconds to spawn the instance on the hypervisor.
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:22:14 user nova-compute[71347]: INFO nova.compute.manager [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Took 7.20 seconds to build instance.
Apr 14 14:22:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-35f365fc-f0f2-4dff-9fc2-0b8f617aeae6 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.302s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:14 user nova-compute[71347]: WARNING nova.compute.manager [req-ee15958b-5312-4f6d-846e-a24b3a0b1f54 req-e7428468-8456-4f89-8a30-fed0ad4b923f service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state active and task_state None.
Apr 14 14:22:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:28 user nova-compute[71347]: INFO nova.compute.manager [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Terminating instance
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received event network-vif-unplugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] Acquiring lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] No waiting events found dispatching network-vif-unplugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-20c0a662-b2e9-4dc9-96fc-95229d938c7e req-935bfc6a-9dc1-41bf-9d28-c25233c5c480 service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received event network-vif-unplugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:22:28 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Instance destroyed successfully.
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.objects.instance [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'resources' on Instance uuid c15d8ed4-3a4b-4c28-be6a-c311b72ecaae {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-221621999',display_name='tempest-VolumesAdminNegativeTest-server-221621999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-221621999',id=14,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:20:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa21be0383ba4cab992ec2b897e763f4',ramdisk_id='',reservation_id='r-8qgobptz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1341751798',owner_user_name='tempest-VolumesAdminNegativeTest-1341751798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:20:41Z,user_data=None,user_id='e5c31630bdcb497da65f928490c26948',uuid=c15d8ed4-3a4b-4c28-be6a-c311b72ecaae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converting VIF {"id": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "address": "fa:16:3e:0a:a8:d0", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce52d8f-41", "ovs_interfaceid": "fce52d8f-41dd-4cce-a3cf-d66cffdbc978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a8:d0,bridge_name='br-int',has_traffic_filtering=True,id=fce52d8f-41dd-4cce-a3cf-d66cffdbc978,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce52d8f-41') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG os_vif [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a8:d0,bridge_name='br-int',has_traffic_filtering=True,id=fce52d8f-41dd-4cce-a3cf-d66cffdbc978,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce52d8f-41') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfce52d8f-41, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:22:28 user nova-compute[71347]: INFO os_vif [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a8:d0,bridge_name='br-int',has_traffic_filtering=True,id=fce52d8f-41dd-4cce-a3cf-d66cffdbc978,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce52d8f-41')
Apr 14 14:22:28 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Deleting instance files /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae_del
Apr 14 14:22:28 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Deletion of /opt/stack/data/nova/instances/c15d8ed4-3a4b-4c28-be6a-c311b72ecaae_del complete
Apr 14 14:22:28 user nova-compute[71347]: INFO nova.compute.manager [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Took 0.76 seconds to destroy the instance on the hypervisor.
Apr 14 14:22:28 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:22:28 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:22:29 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:22:29 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Took 0.56 seconds to deallocate network for instance.
Apr 14 14:22:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-ace76747-a02c-4e8f-b87c-b66183b63747 req-7782dc58-e779-4018-b153-f1f6985c5c6f service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received event network-vif-deleted-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:29 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:22:29 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:22:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:29 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Deleted allocations for instance c15d8ed4-3a4b-4c28-be6a-c311b72ecaae
Apr 14 14:22:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-064dbac2-a5c3-469a-b9f7-b2e8607675e8 tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.887s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received event network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] Acquiring lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] Lock "c15d8ed4-3a4b-4c28-be6a-c311b72ecaae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] No waiting events found dispatching network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:30 user nova-compute[71347]: WARNING nova.compute.manager [req-272e654f-7044-4652-8358-8a6afa4a71df req-04bdb734-f029-4cc7-a0a0-4da438bc886b service nova] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Received unexpected event network-vif-plugged-fce52d8f-41dd-4cce-a3cf-d66cffdbc978 for instance with vm_state deleted and task_state None.
Apr 14 14:22:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:43 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482148.8073487, c15d8ed4-3a4b-4c28-be6a-c311b72ecaae => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:22:43 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] VM Stopped (Lifecycle Event)
Apr 14 14:22:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1725a360-2926-4381-96ca-2a3b1a29bdaa None None] [instance: c15d8ed4-3a4b-4c28-be6a-c311b72ecaae] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:22:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'flavor' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:46 user nova-compute[71347]: INFO nova.compute.manager [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Attaching volume 0591f14c-b6cc-477c-833e-ddb91e7bd431 to /dev/vdb
Apr 14 14:22:46 user nova-compute[71347]: DEBUG os_brick.utils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.066s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c36061-e8ff-4a44-a835-6efdaa8d194d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.033s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c67b40-d7da-4045-a34a-6a59ceec49d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d3b3e7-7380-413e-b8f4-5bb60f0b9654]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5758f9-a1c3-44ed-a7e5-20a94191fcfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:22:46 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:22:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4db0c6-5b9d-4c28-ad74-28f11b839049]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG os_brick.utils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:22:46 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating existing volume attachment record: 7fb5d987-fd05-416a-b000-0f885245ac19 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:22:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxslJkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:22:51 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:22:51 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:22:51 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c3a44a-0dff-4a2d-8405-5c9ab1bab998]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:22:51 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e3322c-1683-4a58-b0aa-9f42ecb86e14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431] added
Apr 14 14:22:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda8561-97c0-4149-9ccc-169f5cc41327]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde581e8-eb7f-4065-9c38-426d194257c9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxslJkdt {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxslJkdt" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b596ea5f-0256-4eea-bcd6-f9cb941831a6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxslJkdt'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ddbad-fb28-43d4-a749-828df02b0d02]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e327fd54-041e-4ea3-be36-dd31dc2beaa7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf4a56e-6e62-4325-b4eb-a43f85bd9b45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260]
Apr 14 14:22:51 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260] successful.
Apr 14 14:22:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9d7cfc-d49c-4f8e-ab52-b331c8a32ca1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6842278-30cd-4bb4-bfb6-869679b89ec1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:51 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:22:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[167f7f27-dfdf-4ed3-98c1-9602d1972330]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:22:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxslJkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-changed-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing instance network info cache due to event network-changed-5c8947cd-1a82-4092-bb65-17dcd80ec71e. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] Acquiring lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] Acquired lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Refreshing network info cache for port 5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updated VIF entry in instance network info cache for port 5c8947cd-1a82-4092-bb65-17dcd80ec71e. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [{"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4deef69-f2eb-4b84-bd2b-8ee3385c67cb req-86ca188b-f18f-4975-a924-decc9674fac8 service nova] Releasing lock "refresh_cache-ed499196-32c8-4f77-92af-f84ed0a2cd62" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26335353437353362', 'path': '/dev/sdg'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335353437353362', 'path': '/dev/sdg'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:22:52 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'flavor' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:22:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:22:53 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:22:53 user nova-compute[71347]:   <source dev="/dev/sdg"/>
Apr 14 14:22:53 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:22:53 user nova-compute[71347]:   <serial>0591f14c-b6cc-477c-833e-ddb91e7bd431</serial>
Apr 14 14:22:53 user nova-compute[71347]: </disk>
Apr 14 14:22:53 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:22:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:22:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:22:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No VIF found with MAC fa:16:3e:4f:47:62, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:22:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f5177d9b-23f6-46dc-84a6-ec1740825453 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.992s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:54 user nova-compute[71347]: INFO nova.compute.manager [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Terminating instance
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-unplugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-aae6c87f-d21d-4805-80f3-b92400663194 req-19d7b580-471b-48d8-b35e-544920c390c9 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-unplugged-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-249f811f-aa71-4b57-91c3-e19d264ff988 req-4bdbdb3b-8217-443f-a11a-4e1ba7dabec4 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-a5f92228-fbae-4d8e-8663-327bff5c0992 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-unplugged-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f52cb24-5897-411d-ba6e-3541c26abf34 req-472fdd33-9a77-4b1d-976e-26af03ec8126 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-bb36f103-c9d3-48be-b171-19ad5e290b03 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:55 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:22:56 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Instance destroyed successfully.
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lazy-loading 'resources' on Instance uuid ed499196-32c8-4f77-92af-f84ed0a2cd62 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:af:1f,bridge_name='br-int',has_traffic_filtering=True,id=5c8947cd-1a82-4092-bb65-17dcd80ec71e,network=Network(19bd0998-e23e-41f1-bb89-e2b88e524bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c8947cd-1a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:af:1f,bridge_name='br-int',has_traffic_filtering=True,id=5c8947cd-1a82-4092-bb65-17dcd80ec71e,network=Network(19bd0998-e23e-41f1-bb89-e2b88e524bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c8947cd-1a') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c8947cd-1a, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: INFO os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:af:1f,bridge_name='br-int',has_traffic_filtering=True,id=5c8947cd-1a82-4092-bb65-17dcd80ec71e,network=Network(19bd0998-e23e-41f1-bb89-e2b88e524bac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c8947cd-1a')
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:54:80,bridge_name='br-int',has_traffic_filtering=True,id=a5f92228-fbae-4d8e-8663-327bff5c0992,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5f92228-fb') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:54:80,bridge_name='br-int',has_traffic_filtering=True,id=a5f92228-fbae-4d8e-8663-327bff5c0992,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5f92228-fb') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5f92228-fb, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: WARNING nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-5c8947cd-1a82-4092-bb65-17dcd80ec71e for instance with vm_state active and task_state deleting.
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-unplugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: WARNING nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 for instance with vm_state active and task_state deleting.
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-unplugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: WARNING nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-4d2eefbe-0a0c-4746-ad92-71766e028a0f for instance with vm_state active and task_state deleting.
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-unplugged-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-70dcece2-b0b6-411e-aece-4c6552fb9331 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: WARNING nova.compute.manager [req-20935682-f28f-4939-8b4f-19d3523b92d4 req-e954d1ef-ee61-4ad9-9ba3-c0de94fd4320 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-70dcece2-b0b6-411e-aece-4c6552fb9331 for instance with vm_state active and task_state deleting.
Apr 14 14:22:56 user nova-compute[71347]: INFO os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:54:80,bridge_name='br-int',has_traffic_filtering=True,id=a5f92228-fbae-4d8e-8663-327bff5c0992,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5f92228-fb')
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=bb36f103-c9d3-48be-b171-19ad5e290b03,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb36f103-c9') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=bb36f103-c9d3-48be-b171-19ad5e290b03,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb36f103-c9') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb36f103-c9, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: INFO os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ea:bd,bridge_name='br-int',has_traffic_filtering=True,id=bb36f103-c9d3-48be-b171-19ad5e290b03,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb36f103-c9')
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "address": "fa:16:3e:3e:9c:23", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3a95fe-e9", "ovs_interfaceid": "5e3a95fe-e9ab-42b6-aab1-94b5da13fd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=5e3a95fe-e9ab-42b6-aab1-94b5da13fd90,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3a95fe-e9') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=5e3a95fe-e9ab-42b6-aab1-94b5da13fd90,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3a95fe-e9') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e3a95fe-e9, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: INFO os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=5e3a95fe-e9ab-42b6-aab1-94b5da13fd90,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3a95fe-e9')
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:7f,bridge_name='br-int',has_traffic_filtering=True,id=441450e6-f5c3-49e5-a923-8fe63e779f1f,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441450e6-f5') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:7f,bridge_name='br-int',has_traffic_filtering=True,id=441450e6-f5c3-49e5-a923-8fe63e779f1f,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441450e6-f5') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap441450e6-f5, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: WARNING nova.compute.manager [req-f46b720b-4d2c-4bcb-ba8e-19dc350df4da req-a350db99-58c9-4f21-9144-6e0994aed74f service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-a5f92228-fbae-4d8e-8663-327bff5c0992 for instance with vm_state active and task_state deleting.
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:56 user nova-compute[71347]: INFO os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:7f,bridge_name='br-int',has_traffic_filtering=True,id=441450e6-f5c3-49e5-a923-8fe63e779f1f,network=Network(0c19db67-7587-4968-a2fb-31685a84ca9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441450e6-f5')
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d2eefbe-0a0c-4746-ad92-71766e028a0f,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2eefbe-0a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d2eefbe-0a0c-4746-ad92-71766e028a0f,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2eefbe-0a') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d2eefbe-0a, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: INFO os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d3:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d2eefbe-0a0c-4746-ad92-71766e028a0f,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2eefbe-0a')
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T14:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-190254133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-190254133',id=16,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOr1PoD5dX6PygV6XKWlaALZ2Hqi8vvQMJRZlC/9p2Wh+T/ZtfWqRjtynrzvOVJccL3npbD/C2joYPZNh6UWNolW+pxcQJ0SuXNaMzhta3EUKrW4PyruKkAAgPgrPeKNw==',key_name='tempest-keypair-43486218',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5faf23277b174ab3aee69e7367a22285',ramdisk_id='',reservation_id='r-0zn04wue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1246501284',owner_user_name='tempest-TaggedBootDevicesTest-1246501284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0bf24630a76646a5b12bec32478b1325',uuid=ed499196-32c8-4f77-92af-f84ed0a2cd62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converting VIF {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:c6:3c,bridge_name='br-int',has_traffic_filtering=True,id=70dcece2-b0b6-411e-aece-4c6552fb9331,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dcece2-b0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c6:3c,bridge_name='br-int',has_traffic_filtering=True,id=70dcece2-b0b6-411e-aece-4c6552fb9331,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dcece2-b0') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70dcece2-b0, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:56 user nova-compute[71347]: INFO os_vif [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:c6:3c,bridge_name='br-int',has_traffic_filtering=True,id=70dcece2-b0b6-411e-aece-4c6552fb9331,network=Network(7b76c4dc-f0a5-4364-99b1-104a1bd68288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dcece2-b0')
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZNyMemR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:22:56 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed011eb-9c0f-406d-9241-a999888f59b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:22:56 user nova-compute[71347]: No targets found.
Apr 14 14:22:56 user nova-compute[71347]: iSNS:
Apr 14 14:22:56 user nova-compute[71347]: No targets found.
Apr 14 14:22:56 user nova-compute[71347]: STATIC:
Apr 14 14:22:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640
Apr 14 14:22:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:22:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431
Apr 14 14:22:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d
Apr 14 14:22:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d
Apr 14 14:22:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570
Apr 14 14:22:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:56 user nova-compute[71347]: FIRMWARE:
Apr 14 14:22:56 user nova-compute[71347]: No targets found.
Apr 14 14:22:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:22:56 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:22:56 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d81850-9f84-4aaf-9429-0dee5594eded]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f66610-8b5e-418d-8731-b6ae88b644e4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: WARNING nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-bb36f103-c9d3-48be-b171-19ad5e290b03 for instance with vm_state active and task_state deleting.
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-unplugged-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-unplugged-441450e6-f5c3-49e5-a923-8fe63e779f1f for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Acquiring lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] No waiting events found dispatching network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:22:56 user nova-compute[71347]: WARNING nova.compute.manager [req-59187dbf-84c6-4d79-9bf0-62e9ff17433a req-b6ae8520-f870-47e5-9fb7-9bd54ca4b283 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received unexpected event network-vif-plugged-441450e6-f5c3-49e5-a923-8fe63e779f1f for instance with vm_state active and task_state deleting.
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:22:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:56 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:22:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ff8332200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9066de-48a6-4056-815a-4740e6972c70]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23ff13e-5e40-4d0e-8fee-b0cb9f72f7d5]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e012285f-d5f4-4d36-8a21-d0543688efca]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20b6a26-c712-40cf-9eef-7f71664208ad]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0039a9b9-7e7a-40db-a3ad-788e440c2eb7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d538a-8227-426c-954e-f0eb818d51f4]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570, portal: 172.16.0.220,3260]
Apr 14 14:22:57 user nova-compute[71347]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570, portal: 172.16.0.220,3260] successful.
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdacc83-d836-4efd-8100-713d62776570 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8efba89-6f99-47b7-b408-0d9c123dc6f3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== disconnect_volume: return (405ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EWkVMUXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:22:57 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e7ebd-2ff9-42e4-8d01-cb2bcebd538b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:22:57 user nova-compute[71347]: No targets found.
Apr 14 14:22:57 user nova-compute[71347]: iSNS:
Apr 14 14:22:57 user nova-compute[71347]: No targets found.
Apr 14 14:22:57 user nova-compute[71347]: STATIC:
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: FIRMWARE:
Apr 14 14:22:57 user nova-compute[71347]: No targets found.
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:22:57 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:22:57 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ed6cf-7655-45c6-873b-7c7c5235caa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8facfa-24ae-4b5d-9a72-386e872042ff]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ff8379a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[38700c05-5034-4c21-898f-b9c72df60a91]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a6ba96-13df-459b-8745-6835601b5d4c]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb749628-dbca-49f8-851e-ad59624a1d9c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfafa140-de9a-4284-bc83-5c8212496cd2]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d92084d-f658-41d7-a0d3-67b2fa5a4674]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d02408-e099-4b5c-a079-4e37be058f95]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640, portal: 172.16.0.220,3260]
Apr 14 14:22:57 user nova-compute[71347]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640, portal: 172.16.0.220,3260] successful.
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eeadcfc-c90f-42a8-ac27-59c55a64e640 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[917ae2e5-acb4-40de-b84a-0e945275e942]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== disconnect_volume: return (359ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNkxVIWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:22:57 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0902ecba-602f-4419-a045-73a526fb5dd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:22:57 user nova-compute[71347]: No targets found.
Apr 14 14:22:57 user nova-compute[71347]: iSNS:
Apr 14 14:22:57 user nova-compute[71347]: No targets found.
Apr 14 14:22:57 user nova-compute[71347]: STATIC:
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d
Apr 14 14:22:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:22:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:22:57 user nova-compute[71347]: FIRMWARE:
Apr 14 14:22:57 user nova-compute[71347]: No targets found.
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:22:57 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:22:57 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd60c3b-d2e5-4357-b622-9edea352b9b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4469e7e4-4578-4bac-adea-806055c236c1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:22:57 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f500770f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4fcd99-bea8-48cd-b9b8-06568040165a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a30203-44b1-4371-9d69-d9f54bad4f04]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e44d07-1853-45b5-9a74-5e77df691a7f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f1c049-3718-45f0-8662-d8b0dee183bc]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[483149a3-6fd7-4739-9c1d-8c0abf43c9c0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[55048ac9-087d-47c7-814b-65b6865c4a7a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d, portal: 172.16.0.220,3260]
Apr 14 14:22:57 user nova-compute[71347]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d, portal: 172.16.0.220,3260] successful.
Apr 14 14:22:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7402d269-0492-44df-b3b6-44553ce0eb8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ef6a8-f217-453c-ad8d-5da8665ec1e9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] <== disconnect_volume: return (352ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:22:57 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Deleting instance files /opt/stack/data/nova/instances/ed499196-32c8-4f77-92af-f84ed0a2cd62_del
Apr 14 14:22:57 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Deletion of /opt/stack/data/nova/instances/ed499196-32c8-4f77-92af-f84ed0a2cd62_del complete
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:58 user nova-compute[71347]: INFO nova.compute.manager [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Took 3.90 seconds to destroy the instance on the hypervisor.
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG nova.compute.manager [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-changed-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG nova.compute.manager [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing instance network info cache due to event network-changed-cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] Acquiring lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] Acquired lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG nova.network.neutron [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing network info cache for port cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:22:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG nova.network.neutron [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updated VIF entry in instance network info cache for port cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG nova.network.neutron [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating instance_info_cache with network_info: [{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-deleted-5e3a95fe-e9ab-42b6-aab1-94b5da13fd90 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:00 user nova-compute[71347]: INFO nova.compute.manager [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Neutron deleted interface 5e3a95fe-e9ab-42b6-aab1-94b5da13fd90; detaching it from the instance and deleting it from the info cache
Apr 14 14:23:00 user nova-compute[71347]: DEBUG nova.network.neutron [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [{"id": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "address": "fa:16:3e:84:af:1f", "network": {"id": "19bd0998-e23e-41f1-bb89-e2b88e524bac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1428891653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c8947cd-1a", "ovs_interfaceid": "5c8947cd-1a82-4092-bb65-17dcd80ec71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:00 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:23:00 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:23:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7440MB free_disk=26.54137420654297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-52a63e4d-3c87-495e-8963-c93d2dc6ba8e req-8009a7e3-814e-401b-8fe2-915e8e1eee92 service nova] Releasing lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-f2b57447-6df9-42ae-864f-b458908a5a22 req-8d01f1b7-171e-4c34-9e76-cc0a17d8d7c8 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Detach interface failed, port_id=5e3a95fe-e9ab-42b6-aab1-94b5da13fd90, reason: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance bc70d475-20dd-4859-a6fe-d2d09341799e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 201765ec-21d3-4a0e-89f0-ece907f350bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fafce4d3-18c4-4f15-af62-e599c7749efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e81e92d6-b79e-46db-b69e-1f7584440287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-changed-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing instance network info cache due to event network-changed-cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] Acquiring lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] Acquired lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.network.neutron [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing network info cache for port cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:23:02 user nova-compute[71347]: INFO nova.compute.manager [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Detaching volume 056480e9-af67-44cc-962d-bff93d69382d
Apr 14 14:23:02 user nova-compute[71347]: INFO nova.virt.block_device [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Attempting to driver detach volume 056480e9-af67-44cc-962d-bff93d69382d from mountpoint /dev/vdc
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Attempting to detach device vdc from instance e81e92d6-b79e-46db-b69e-1f7584440287 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:23:02 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:23:02 user nova-compute[71347]:   <source dev="/dev/sdf"/>
Apr 14 14:23:02 user nova-compute[71347]:   <target dev="vdc" bus="virtio"/>
Apr 14 14:23:02 user nova-compute[71347]:   <serial>056480e9-af67-44cc-962d-bff93d69382d</serial>
Apr 14 14:23:02 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 14:23:02 user nova-compute[71347]: </disk>
Apr 14 14:23:02 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:23:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully detached device vdc from instance e81e92d6-b79e-46db-b69e-1f7584440287 from the persistent domain config.
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e81e92d6-b79e-46db-b69e-1f7584440287 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:23:02 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:23:02 user nova-compute[71347]:   <source dev="/dev/sdf"/>
Apr 14 14:23:02 user nova-compute[71347]:   <target dev="vdc" bus="virtio"/>
Apr 14 14:23:02 user nova-compute[71347]:   <serial>056480e9-af67-44cc-962d-bff93d69382d</serial>
Apr 14 14:23:02 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 14:23:02 user nova-compute[71347]: </disk>
Apr 14 14:23:02 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-deleted-5c8947cd-1a82-4092-bb65-17dcd80ec71e {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:02 user nova-compute[71347]: INFO nova.compute.manager [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Neutron deleted interface 5c8947cd-1a82-4092-bb65-17dcd80ec71e; detaching it from the instance and deleting it from the info cache
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.network.neutron [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [{"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "address": "fa:16:3e:99:d3:e1", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2eefbe-0a", "ovs_interfaceid": "4d2eefbe-0a0c-4746-ad92-71766e028a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Detach interface failed, port_id=5c8947cd-1a82-4092-bb65-17dcd80ec71e, reason: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-deleted-4d2eefbe-0a0c-4746-ad92-71766e028a0f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:02 user nova-compute[71347]: INFO nova.compute.manager [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Neutron deleted interface 4d2eefbe-0a0c-4746-ad92-71766e028a0f; detaching it from the instance and deleting it from the info cache
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.network.neutron [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [{"id": "a5f92228-fbae-4d8e-8663-327bff5c0992", "address": "fa:16:3e:a1:54:80", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f92228-fb", "ovs_interfaceid": "a5f92228-fbae-4d8e-8663-327bff5c0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb36f103-c9d3-48be-b171-19ad5e290b03", "address": "fa:16:3e:f2:ea:bd", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb36f103-c9", "ovs_interfaceid": "bb36f103-c9d3-48be-b171-19ad5e290b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "address": "fa:16:3e:c9:5b:7f", "network": {"id": "0c19db67-7587-4968-a2fb-31685a84ca9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1576380419", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441450e6-f5", "ovs_interfaceid": "441450e6-f5c3-49e5-a923-8fe63e779f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "70dcece2-b0b6-411e-aece-4c6552fb9331", "address": "fa:16:3e:40:c6:3c", "network": {"id": "7b76c4dc-f0a5-4364-99b1-104a1bd68288", "bridge": "br-int", "label": "tempest-device-tagging-net2-325714452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5faf23277b174ab3aee69e7367a22285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dcece2-b0", "ovs_interfaceid": "70dcece2-b0b6-411e-aece-4c6552fb9331", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-63a7f4c3-b045-4b70-ab31-0a0a8aa54cf4 req-307ff447-dec5-44f3-8db0-927ddb8a1a80 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Detach interface failed, port_id=4d2eefbe-0a0c-4746-ad92-71766e028a0f, reason: Instance ed499196-32c8-4f77-92af-f84ed0a2cd62 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:23:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482183.125965, e81e92d6-b79e-46db-b69e-1f7584440287 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:23:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully detached device vdc from instance e81e92d6-b79e-46db-b69e-1f7584440287 from the live domain config.
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NohgiMmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:23:03 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec013449-46b6-4ef3-9ddb-26f589159500]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:23:03 user nova-compute[71347]: No targets found.
Apr 14 14:23:03 user nova-compute[71347]: iSNS:
Apr 14 14:23:03 user nova-compute[71347]: No targets found.
Apr 14 14:23:03 user nova-compute[71347]: STATIC:
Apr 14 14:23:03 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:23:03 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:23:03 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:23:03 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431
Apr 14 14:23:03 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:23:03 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:23:03 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d
Apr 14 14:23:03 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:23:03 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:23:03 user nova-compute[71347]: FIRMWARE:
Apr 14 14:23:03 user nova-compute[71347]: No targets found.
Apr 14 14:23:03 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:23:03 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:23:03 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe1e52-417a-4d87-bcb2-8f01fb51d770]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c562c5-1833-4f79-a8cb-4f719ee4928c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Took 5.15 seconds to deallocate network for instance.
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:03 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:23:03 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:03 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:03 user nova-compute[71347]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d (non-flash)
Apr 14 14:23:03 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:03 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f500789f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d'): ({'sdf'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Removing single pathed devices sdf {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b546cf82-7b16-4773-b992-244ae07416db]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fd2e04-7c6a-4734-bc78-c049e445f817]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flushing IO for device /dev/sdf {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d563f10c-3f08-4fb4-8049-65aeea242ff0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fec8593-7e99-4fb4-b58a-10a8d9ca2d31]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] SCSI volumes sdf have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74b01ac-8e07-4710-85e0-df832ee1c32c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.network.neutron [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updated VIF entry in instance network info cache for port cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.network.neutron [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating instance_info_cache with network_info: [{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cfd91c-b1c2-48ab-8698-273fbcb2f983]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d, portal: 172.16.0.220,3260]
Apr 14 14:23:03 user nova-compute[71347]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d, portal: 172.16.0.220,3260] successful.
Apr 14 14:23:03 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e651e4d2-6918-4bdd-8b13-ac3b24e62090 req-e00ab450-ec8d-4cef-8b11-85b074bc774e service nova] Releasing lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056480e9-af67-44cc-962d-bff93d69382d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4977ac-47b1-41cd-9d54-a7485d634833]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] <== disconnect_volume: return (335ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updating instance_info_cache with network_info: [{"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-bc70d475-20dd-4859-a6fe-d2d09341799e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received event network-changed-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Refreshing instance network info cache due to event network-changed-b3956c03-e69e-4181-940f-8e9e890b36ad. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] Acquiring lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] Acquired lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG nova.network.neutron [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Refreshing network info cache for port b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'flavor' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0ef4f80c-50d1-4e72-ad9c-0dcf75bb79bc tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.973s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG nova.network.neutron [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Updated VIF entry in instance network info cache for port b3956c03-e69e-4181-940f-8e9e890b36ad. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG nova.network.neutron [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Updating instance_info_cache with network_info: [{"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-152b4f4a-599f-47c8-b91c-0ac0561ad427 req-0927f1c6-c402-4b77-ac45-908251fcf5ea service nova] Releasing lock "refresh_cache-fafce4d3-18c4-4f15-af62-e599c7749efe" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-deleted-70dcece2-b0b6-411e-aece-4c6552fb9331 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-25c807c0-7689-4626-9bf6-b3d25826602f req-7cebde50-239f-42c2-afbd-d667e0608253 service nova] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Received event network-vif-deleted-441450e6-f5c3-49e5-a923-8fe63e779f1f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:05 user nova-compute[71347]: INFO nova.compute.manager [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Took 2.60 seconds to detach 3 volumes for instance.
Apr 14 14:23:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:05 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:23:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:23:06 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:23:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:23:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:23:06 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:23:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:23:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:06 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Deleted allocations for instance ed499196-32c8-4f77-92af-f84ed0a2cd62
Apr 14 14:23:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4461ee36-fed2-4e1b-85fb-b8450fb6c315 tempest-TaggedBootDevicesTest-1246501284 tempest-TaggedBootDevicesTest-1246501284-project-member] Lock "ed499196-32c8-4f77-92af-f84ed0a2cd62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.385s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:07 user nova-compute[71347]: INFO nova.compute.manager [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Rebooting instance
Apr 14 14:23:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquired lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating instance_info_cache with network_info: [{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Releasing lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:08 user nova-compute[71347]: INFO nova.compute.manager [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Attaching volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 to /dev/vdb
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-unplugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] No waiting events found dispatching network-vif-unplugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:08 user nova-compute[71347]: WARNING nova.compute.manager [req-261b81e1-6947-48e5-8743-24fd76b8f200 req-ed4a9a7c-d133-40a1-854b-8eaefeeadffa service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received unexpected event network-vif-unplugged-cc694601-d879-4214-ac40-2242faaec5bf for instance with vm_state active and task_state reboot_started_hard.
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.utils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac195a79-439a-47ab-bafd-e62726cf76b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e8b60-4381-495a-8579-8c421f48d742]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6a1a83-047c-42cc-8315-172b4cf943fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd39c6d0-2609-4eae-be9a-b7d1a66d94f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:23:08 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc0168-46b3-45c6-8744-2037a3587dae]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.utils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Updating existing volume attachment record: 08b99b1f-a64e-42d1-b873-ee6e4a0e1df1 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:23:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance destroyed successfully.
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'resources' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-482352325',display_name='tempest-TestMinimumBasicScenario-server-482352325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-482352325',id=15,image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCxxTX8m3sMjnQj10SbCLU0c/Ymb1VjMlB32qA7VxA2M07x/CXWwPIkJsT/KA8EBVjTpbWmbxfVPBZXTWP3k4z2LdlrRlImx/6QWiz51uLgrOJ7Bz3Oub23zXIvs42WMg==',key_name='tempest-TestMinimumBasicScenario-2096424138',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-3jz3gczk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:23:08Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=201765ec-21d3-4a0e-89f0-ece907f350bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_vif [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc694601-d8, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:23:08 user nova-compute[71347]: INFO os_vif [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8')
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxslJkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:23:08 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caa1852-c09f-456b-adeb-f5e3217d50f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:23:08 user nova-compute[71347]: No targets found.
Apr 14 14:23:08 user nova-compute[71347]: iSNS:
Apr 14 14:23:08 user nova-compute[71347]: No targets found.
Apr 14 14:23:08 user nova-compute[71347]: STATIC:
Apr 14 14:23:08 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:23:08 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:23:08 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:23:08 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431
Apr 14 14:23:08 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:23:08 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:23:08 user nova-compute[71347]: FIRMWARE:
Apr 14 14:23:08 user nova-compute[71347]: No targets found.
Apr 14 14:23:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:23:08 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:23:08 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd50283-c562-4bbe-8910-47d85b4d335c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a84ce06-e00e-4ebb-ba51-f69895f9c645]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:08 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:08 user nova-compute[71347]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ff837ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431'): ({'sdg'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Removing single pathed devices sdg {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3067b24-4a59-4998-be3f-5fae03f3fd9d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a863a-8470-4caf-a54c-7a181be50579]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flushing IO for device /dev/sdg {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1351fbb-be7a-47d8-8e5e-96cb4268e233]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09042f9-1c5d-438e-8cce-0905f6557dfb]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] SCSI volumes sdg have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b170a4b2-3587-46f3-939e-876a5c3cc509]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[45190d40-9660-458a-b639-cd0f7ae2faf8]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260]
Apr 14 14:23:08 user nova-compute[71347]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260] successful.
Apr 14 14:23:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c41ec81-3184-417d-b825-c073f34edac7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] <== disconnect_volume: return (293ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:23:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Start _get_guest_xml network_info=[{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cb83aa4-680b-4b06-9ae7-13ba22013082,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '2cb83aa4-680b-4b06-9ae7-13ba22013082'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxslJkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '201765ec-21d3-4a0e-89f0-ece907f350bf', 'attached_at': '', 'detached_at': '', 'volume_id': '0591f14c-b6cc-477c-833e-ddb91e7bd431', 'serial': '0591f14c-b6cc-477c-833e-ddb91e7bd431'}, 'attachment_id': '7fb5d987-fd05-416a-b000-0f885245ac19', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:23:09 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:23:09 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cb83aa4-680b-4b06-9ae7-13ba22013082,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'vcpu_model' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxslJkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:23:09 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:23:09 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:23:09 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b42392-43e8-4387-ae14-f5875ef389f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:23:09 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3f329-f694-4782-8836-d7783f9aeb36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431] added
Apr 14 14:23:09 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e38fae-ad7c-4bac-859a-a950cf6fb89f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d67879-2796-4624-86a2-e116d8136bb8]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxslJkdt {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxslJkdt" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[044dd76f-8bf2-400d-af40-26e44d0bb830]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxslJkdt'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[94da265a-8ba7-49cc-86d2-928d24e4d4da]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eae0324-66a3-4876-a861-dd2f0e02085b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:09 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:09 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7378cbbf-f2dc-4b43-af67-d15442d67538]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260]
Apr 14 14:23:09 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260] successful.
Apr 14 14:23:09 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[59323763-2590-4aad-95d3-a7d1be61c633]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c838e95-2efc-43a0-9499-199cfb59f47f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:09 user nova-compute[71347]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:09 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:09 user nova-compute[71347]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:09 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bb6174-9b6d-4b08-977a-7407ccd81897]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:09 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] No waiting events found dispatching network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:10 user nova-compute[71347]: WARNING nova.compute.manager [req-f3b01033-a32f-470f-8166-763325b59908 req-36fa4f9b-db03-4f8d-9f84-274e0724e1d4 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received unexpected event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf for instance with vm_state active and task_state reboot_started_hard.
Apr 14 14:23:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxslJkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26335353437353362', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335353437353362', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-482352325',display_name='tempest-TestMinimumBasicScenario-server-482352325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-482352325',id=15,image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCxxTX8m3sMjnQj10SbCLU0c/Ymb1VjMlB32qA7VxA2M07x/CXWwPIkJsT/KA8EBVjTpbWmbxfVPBZXTWP3k4z2LdlrRlImx/6QWiz51uLgrOJ7Bz3Oub23zXIvs42WMg==',key_name='tempest-TestMinimumBasicScenario-2096424138',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-3jz3gczk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:23:08Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=201765ec-21d3-4a0e-89f0-ece907f350bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'pci_devices' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:23:10 user nova-compute[71347]:   <uuid>201765ec-21d3-4a0e-89f0-ece907f350bf</uuid>
Apr 14 14:23:10 user nova-compute[71347]:   <name>instance-0000000f</name>
Apr 14 14:23:10 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:23:10 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:23:10 user nova-compute[71347]:   <metadata>
Apr 14 14:23:10 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:23:10 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:23:10 user nova-compute[71347]:       <nova:name>tempest-TestMinimumBasicScenario-server-482352325</nova:name>
Apr 14 14:23:10 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:23:09</nova:creationTime>
Apr 14 14:23:10 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:23:10 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:23:10 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:23:10 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:23:10 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:23:10 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:23:10 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:23:10 user nova-compute[71347]:       <nova:owner>
Apr 14 14:23:10 user nova-compute[71347]:         <nova:user uuid="19dad04c158549c39991ea05fca2531d">tempest-TestMinimumBasicScenario-248098662-project-member</nova:user>
Apr 14 14:23:10 user nova-compute[71347]:         <nova:project uuid="1df398dd4f844286b41ee4948001013a">tempest-TestMinimumBasicScenario-248098662</nova:project>
Apr 14 14:23:10 user nova-compute[71347]:       </nova:owner>
Apr 14 14:23:10 user nova-compute[71347]:       <nova:root type="image" uuid="2cb83aa4-680b-4b06-9ae7-13ba22013082"/>
Apr 14 14:23:10 user nova-compute[71347]:       <nova:ports>
Apr 14 14:23:10 user nova-compute[71347]:         <nova:port uuid="cc694601-d879-4214-ac40-2242faaec5bf">
Apr 14 14:23:10 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:23:10 user nova-compute[71347]:         </nova:port>
Apr 14 14:23:10 user nova-compute[71347]:       </nova:ports>
Apr 14 14:23:10 user nova-compute[71347]:     </nova:instance>
Apr 14 14:23:10 user nova-compute[71347]:   </metadata>
Apr 14 14:23:10 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:23:10 user nova-compute[71347]:     <system>
Apr 14 14:23:10 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:23:10 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:23:10 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:23:10 user nova-compute[71347]:       <entry name="serial">201765ec-21d3-4a0e-89f0-ece907f350bf</entry>
Apr 14 14:23:10 user nova-compute[71347]:       <entry name="uuid">201765ec-21d3-4a0e-89f0-ece907f350bf</entry>
Apr 14 14:23:10 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:23:10 user nova-compute[71347]:     </system>
Apr 14 14:23:10 user nova-compute[71347]:   </sysinfo>
Apr 14 14:23:10 user nova-compute[71347]:   <os>
Apr 14 14:23:10 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:23:10 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:23:10 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:23:10 user nova-compute[71347]:   </os>
Apr 14 14:23:10 user nova-compute[71347]:   <features>
Apr 14 14:23:10 user nova-compute[71347]:     <acpi/>
Apr 14 14:23:10 user nova-compute[71347]:     <apic/>
Apr 14 14:23:10 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:23:10 user nova-compute[71347]:   </features>
Apr 14 14:23:10 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:23:10 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:23:10 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:23:10 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:23:10 user nova-compute[71347]:   </clock>
Apr 14 14:23:10 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:23:10 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:23:10 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:23:10 user nova-compute[71347]:   </cpu>
Apr 14 14:23:10 user nova-compute[71347]:   <devices>
Apr 14 14:23:10 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:23:10 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:23:10 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk"/>
Apr 14 14:23:10 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:23:10 user nova-compute[71347]:     </disk>
Apr 14 14:23:10 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:23:10 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:23:10 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:23:10 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:23:10 user nova-compute[71347]:       <serial>0591f14c-b6cc-477c-833e-ddb91e7bd431</serial>
Apr 14 14:23:10 user nova-compute[71347]:     </disk>
Apr 14 14:23:10 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:23:10 user nova-compute[71347]:       <mac address="fa:16:3e:4f:47:62"/>
Apr 14 14:23:10 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:23:10 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:23:10 user nova-compute[71347]:       <target dev="tapcc694601-d8"/>
Apr 14 14:23:10 user nova-compute[71347]:     </interface>
Apr 14 14:23:10 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:23:10 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/console.log" append="off"/>
Apr 14 14:23:10 user nova-compute[71347]:     </serial>
Apr 14 14:23:10 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:23:10 user nova-compute[71347]:     <video>
Apr 14 14:23:10 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:23:10 user nova-compute[71347]:     </video>
Apr 14 14:23:10 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:23:10 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:23:10 user nova-compute[71347]:     </rng>
Apr 14 14:23:10 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:23:10 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:23:10 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:23:10 user nova-compute[71347]:     </memballoon>
Apr 14 14:23:10 user nova-compute[71347]:   </devices>
Apr 14 14:23:10 user nova-compute[71347]: </domain>
Apr 14 14:23:10 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'trusted_certs' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Cannot resize image /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'migration_context' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-482352325',display_name='tempest-TestMinimumBasicScenario-server-482352325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-482352325',id=15,image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCxxTX8m3sMjnQj10SbCLU0c/Ymb1VjMlB32qA7VxA2M07x/CXWwPIkJsT/KA8EBVjTpbWmbxfVPBZXTWP3k4z2LdlrRlImx/6QWiz51uLgrOJ7Bz3Oub23zXIvs42WMg==',key_name='tempest-TestMinimumBasicScenario-2096424138',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-3jz3gczk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:23:08Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=201765ec-21d3-4a0e-89f0-ece907f350bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:23:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG os_vif [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc694601-d8, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc694601-d8, col_values=(('external_ids', {'iface-id': 'cc694601-d879-4214-ac40-2242faaec5bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:47:62', 'vm-uuid': '201765ec-21d3-4a0e-89f0-ece907f350bf'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:23:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:11 user nova-compute[71347]: INFO os_vif [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8')
Apr 14 14:23:11 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482176.0738647, ed499196-32c8-4f77-92af-f84ed0a2cd62 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:23:11 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] VM Stopped (Lifecycle Event)
Apr 14 14:23:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-29f384dc-90ae-4b36-ac31-a9ceca83a971 None None] [instance: ed499196-32c8-4f77-92af-f84ed0a2cd62] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] No waiting events found dispatching network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:12 user nova-compute[71347]: WARNING nova.compute.manager [req-e7b5d159-6e97-4de0-9bff-646c47cb4017 req-68bff80f-e4a6-4a90-9bfc-b62194a84e39 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received unexpected event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf for instance with vm_state active and task_state reboot_started_hard.
Apr 14 14:23:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjMmeSnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:23:12 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:23:12 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:23:12 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c2eb2a-9b7d-491c-986b-7271c92f1876]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:23:12 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a84887-415c-4ccf-942b-dfed9fa4b505]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696] added
Apr 14 14:23:12 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8821e-6879-4a67-8153-a69744337c26]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ce81b-9748-4a2b-9237-351aba2fb0ef]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjMmeSnr {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjMmeSnr" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2148969-de0b-4e32-b71a-7979725683c4]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pjMmeSnr'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc9e7c2-f4c0-45de-b622-a1bfd77d19d3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b359f9-fa39-40c1-9ca0-8022e4ea70d5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb6d171-b365-43f2-93a9-8736dd36dbb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696, portal: 172.16.0.220,3260]
Apr 14 14:23:13 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696, portal: 172.16.0.220,3260] successful.
Apr 14 14:23:13 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd5b59c-330c-4646-9648-1710a1c09894]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f716d1-0ba3-4d66-8dda-565f35384a21]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:23:13 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3d9511-d8ad-4d12-8e18-f2167345a669]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:23:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjMmeSnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23965656665616564', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965656665616564', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:23:14 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:23:14 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:23:14 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:23:14 user nova-compute[71347]:   <serial>f8f8a6ce-1a76-4c0b-909c-96ff91ba5696</serial>
Apr 14 14:23:14 user nova-compute[71347]: </disk>
Apr 14 14:23:14 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 201765ec-21d3-4a0e-89f0-ece907f350bf due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482194.5028, 201765ec-21d3-4a0e-89f0-ece907f350bf => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:23:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] VM Resumed (Lifecycle Event)
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:14 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance rebooted successfully.
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:23:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482194.513457, 201765ec-21d3-4a0e-89f0-ece907f350bf => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:23:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] VM Started (Lifecycle Event)
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:23:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 14:23:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ea21f77c-7b3a-4fb6-beda-7b87b3a3a0b9 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.445s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No VIF found with MAC fa:16:3e:05:38:67, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] No waiting events found dispatching network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:14 user nova-compute[71347]: WARNING nova.compute.manager [req-2ca69813-2e25-4c28-a044-d74b01dc0779 req-9a63297b-36d1-4ebf-ac98-3ea7ddc05f0c service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received unexpected event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf for instance with vm_state active and task_state None.
Apr 14 14:23:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4ac210c4-e436-4215-8ea7-a07fb8757ca5 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.669s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:23:19 user nova-compute[71347]: INFO nova.compute.claims [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Claim successful on node user
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:23:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.policy [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:23:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Creating image(s)
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "/opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "/opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk 1073741824" returned: 0 in 0.054s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Cannot resize image /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'migration_context' on Instance uuid d9de3e2a-3325-4bc9-bfb3-9388a620abaf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Ensure instance console log exists: /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:20 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Successfully created port: 50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Successfully updated port: 50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquired lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-changed-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Refreshing instance network info cache due to event network-changed-50c5a068-52cf-43f3-8065-6ada257d3449. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] Acquiring lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:21 user nova-compute[71347]: INFO nova.compute.manager [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Terminating instance
Apr 14 14:23:21 user nova-compute[71347]: DEBUG nova.compute.manager [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Updating instance_info_cache with network_info: [{"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Releasing lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Instance network_info: |[{"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] Acquired lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.network.neutron [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Refreshing network info cache for port 50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Start _get_guest_xml network_info=[{"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:23:22 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2116395706',display_name='tempest-AttachVolumeNegativeTest-server-2116395706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2116395706',id=20,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESnavlENNjfXDBBjXZH0TsbH9EKMFE+T6Mpv2iIokkBQmdhZm5u1mpWFB6kBhDC2cGq5kV6NVzXAe9L+Fdg5KFHQcqHOskojjP9fpyzYiJBlhppafU1+xltOvvYIodn/w==',key_name='tempest-keypair-630351444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-91nr5cq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:23:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=d9de3e2a-3325-4bc9-bfb3-9388a620abaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:61,bridge_name='br-int',has_traffic_filtering=True,id=50c5a068-52cf-43f3-8065-6ada257d3449,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c5a068-52') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'pci_devices' on Instance uuid d9de3e2a-3325-4bc9-bfb3-9388a620abaf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:23:22 user nova-compute[71347]:   <uuid>d9de3e2a-3325-4bc9-bfb3-9388a620abaf</uuid>
Apr 14 14:23:22 user nova-compute[71347]:   <name>instance-00000014</name>
Apr 14 14:23:22 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:23:22 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:23:22 user nova-compute[71347]:   <metadata>
Apr 14 14:23:22 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:23:22 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:23:22 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2116395706</nova:name>
Apr 14 14:23:22 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:23:22</nova:creationTime>
Apr 14 14:23:22 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:23:22 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:23:22 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:23:22 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:23:22 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:23:22 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:23:22 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:23:22 user nova-compute[71347]:       <nova:owner>
Apr 14 14:23:22 user nova-compute[71347]:         <nova:user uuid="5db83169bedc4520b5e2a2b595362ec1">tempest-AttachVolumeNegativeTest-134968716-project-member</nova:user>
Apr 14 14:23:22 user nova-compute[71347]:         <nova:project uuid="df56fb88b961464496757a358fd15169">tempest-AttachVolumeNegativeTest-134968716</nova:project>
Apr 14 14:23:22 user nova-compute[71347]:       </nova:owner>
Apr 14 14:23:22 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:23:22 user nova-compute[71347]:       <nova:ports>
Apr 14 14:23:22 user nova-compute[71347]:         <nova:port uuid="50c5a068-52cf-43f3-8065-6ada257d3449">
Apr 14 14:23:22 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 14:23:22 user nova-compute[71347]:         </nova:port>
Apr 14 14:23:22 user nova-compute[71347]:       </nova:ports>
Apr 14 14:23:22 user nova-compute[71347]:     </nova:instance>
Apr 14 14:23:22 user nova-compute[71347]:   </metadata>
Apr 14 14:23:22 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:23:22 user nova-compute[71347]:     <system>
Apr 14 14:23:22 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:23:22 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:23:22 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:23:22 user nova-compute[71347]:       <entry name="serial">d9de3e2a-3325-4bc9-bfb3-9388a620abaf</entry>
Apr 14 14:23:22 user nova-compute[71347]:       <entry name="uuid">d9de3e2a-3325-4bc9-bfb3-9388a620abaf</entry>
Apr 14 14:23:22 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:23:22 user nova-compute[71347]:     </system>
Apr 14 14:23:22 user nova-compute[71347]:   </sysinfo>
Apr 14 14:23:22 user nova-compute[71347]:   <os>
Apr 14 14:23:22 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:23:22 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:23:22 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:23:22 user nova-compute[71347]:   </os>
Apr 14 14:23:22 user nova-compute[71347]:   <features>
Apr 14 14:23:22 user nova-compute[71347]:     <acpi/>
Apr 14 14:23:22 user nova-compute[71347]:     <apic/>
Apr 14 14:23:22 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:23:22 user nova-compute[71347]:   </features>
Apr 14 14:23:22 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:23:22 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:23:22 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:23:22 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:23:22 user nova-compute[71347]:   </clock>
Apr 14 14:23:22 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:23:22 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:23:22 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:23:22 user nova-compute[71347]:   </cpu>
Apr 14 14:23:22 user nova-compute[71347]:   <devices>
Apr 14 14:23:22 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:23:22 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:23:22 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk"/>
Apr 14 14:23:22 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:23:22 user nova-compute[71347]:     </disk>
Apr 14 14:23:22 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:23:22 user nova-compute[71347]:       <mac address="fa:16:3e:a3:85:61"/>
Apr 14 14:23:22 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:23:22 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:23:22 user nova-compute[71347]:       <target dev="tap50c5a068-52"/>
Apr 14 14:23:22 user nova-compute[71347]:     </interface>
Apr 14 14:23:22 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:23:22 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/console.log" append="off"/>
Apr 14 14:23:22 user nova-compute[71347]:     </serial>
Apr 14 14:23:22 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:23:22 user nova-compute[71347]:     <video>
Apr 14 14:23:22 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:23:22 user nova-compute[71347]:     </video>
Apr 14 14:23:22 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:23:22 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:23:22 user nova-compute[71347]:     </rng>
Apr 14 14:23:22 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:23:22 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:23:22 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:23:22 user nova-compute[71347]:     </memballoon>
Apr 14 14:23:22 user nova-compute[71347]:   </devices>
Apr 14 14:23:22 user nova-compute[71347]: </domain>
Apr 14 14:23:22 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2116395706',display_name='tempest-AttachVolumeNegativeTest-server-2116395706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2116395706',id=20,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESnavlENNjfXDBBjXZH0TsbH9EKMFE+T6Mpv2iIokkBQmdhZm5u1mpWFB6kBhDC2cGq5kV6NVzXAe9L+Fdg5KFHQcqHOskojjP9fpyzYiJBlhppafU1+xltOvvYIodn/w==',key_name='tempest-keypair-630351444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-91nr5cq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:23:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=d9de3e2a-3325-4bc9-bfb3-9388a620abaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:61,bridge_name='br-int',has_traffic_filtering=True,id=50c5a068-52cf-43f3-8065-6ada257d3449,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c5a068-52') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG os_vif [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:61,bridge_name='br-int',has_traffic_filtering=True,id=50c5a068-52cf-43f3-8065-6ada257d3449,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c5a068-52') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50c5a068-52, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50c5a068-52, col_values=(('external_ids', {'iface-id': '50c5a068-52cf-43f3-8065-6ada257d3449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:85:61', 'vm-uuid': 'd9de3e2a-3325-4bc9-bfb3-9388a620abaf'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: INFO os_vif [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:61,bridge_name='br-int',has_traffic_filtering=True,id=50c5a068-52cf-43f3-8065-6ada257d3449,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c5a068-52')
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No VIF found with MAC fa:16:3e:a3:85:61, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.compute.manager [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received event network-vif-unplugged-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.compute.manager [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] No waiting events found dispatching network-vif-unplugged-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.compute.manager [req-8361f3e4-5efc-47f4-959e-fde55aeb1311 req-490c2583-d3aa-450b-9653-84e6772c864a service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received event network-vif-unplugged-513e9086-658d-44df-962e-3a4f16649083 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.network.neutron [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Updated VIF entry in instance network info cache for port 50c5a068-52cf-43f3-8065-6ada257d3449. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.network.neutron [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Updating instance_info_cache with network_info: [{"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4ec8a352-72ab-487a-acb4-57ec20a9a70b req-26922ebb-17ed-4a07-9e3d-7a7f0da2d60c service nova] Releasing lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:22 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Instance destroyed successfully.
Apr 14 14:23:22 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lazy-loading 'resources' on Instance uuid bc70d475-20dd-4859-a6fe-d2d09341799e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1556722134',display_name='tempest-VolumesAdminNegativeTest-server-1556722134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1556722134',id=8,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQjfgmzxezY/KHcd5PdM3vkmvQnoAgqCZxGXXY6YTcu6O1yAZ/H9Mco+AeVrFCASW4ysVKsiv7y+LJXoAzQa4DW0tB/Tt/+WW7OwCivZK7OhQt19fhtQAO7wQJzSLFMQg==',key_name='tempest-keypair-706581506',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa21be0383ba4cab992ec2b897e763f4',ramdisk_id='',reservation_id='r-jz0z2cjc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1341751798',owner_user_name='tempest-VolumesAdminNegativeTest-1341751798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5c31630bdcb497da65f928490c26948',uuid=bc70d475-20dd-4859-a6fe-d2d09341799e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converting VIF {"id": "513e9086-658d-44df-962e-3a4f16649083", "address": "fa:16:3e:3e:41:4f", "network": {"id": "40223427-597e-4817-ab9c-7e8119692b79", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1174698336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21be0383ba4cab992ec2b897e763f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap513e9086-65", "ovs_interfaceid": "513e9086-658d-44df-962e-3a4f16649083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:41:4f,bridge_name='br-int',has_traffic_filtering=True,id=513e9086-658d-44df-962e-3a4f16649083,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513e9086-65') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG os_vif [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:41:4f,bridge_name='br-int',has_traffic_filtering=True,id=513e9086-658d-44df-962e-3a4f16649083,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513e9086-65') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap513e9086-65, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: INFO os_vif [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:41:4f,bridge_name='br-int',has_traffic_filtering=True,id=513e9086-658d-44df-962e-3a4f16649083,network=Network(40223427-597e-4817-ab9c-7e8119692b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513e9086-65')
Apr 14 14:23:23 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Deleting instance files /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e_del
Apr 14 14:23:23 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Deletion of /opt/stack/data/nova/instances/bc70d475-20dd-4859-a6fe-d2d09341799e_del complete
Apr 14 14:23:23 user nova-compute[71347]: INFO nova.compute.manager [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 14 14:23:23 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:24 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Took 1.06 seconds to deallocate network for instance.
Apr 14 14:23:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-cfe89ee5-397c-4f75-8bc7-83ebf287ebb7 req-c34fed29-a0ca-4d9d-9e2f-079fdefb0533 service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received event network-vif-deleted-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received event network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] Acquiring lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] No waiting events found dispatching network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:24 user nova-compute[71347]: WARNING nova.compute.manager [req-62beb331-b5a2-46b7-aa69-2952d45ab73a req-7b0008bb-7d89-41a9-9d6f-da19bedcf3bf service nova] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Received unexpected event network-vif-plugged-513e9086-658d-44df-962e-3a4f16649083 for instance with vm_state deleted and task_state None.
Apr 14 14:23:24 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Deleted allocations for instance bc70d475-20dd-4859-a6fe-d2d09341799e
Apr 14 14:23:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fd341516-de88-4516-9d60-abd1cf675cba tempest-VolumesAdminNegativeTest-1341751798 tempest-VolumesAdminNegativeTest-1341751798-project-member] Lock "bc70d475-20dd-4859-a6fe-d2d09341799e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.747s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] No waiting events found dispatching network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:26 user nova-compute[71347]: WARNING nova.compute.manager [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received unexpected event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 for instance with vm_state building and task_state spawning.
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] No waiting events found dispatching network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:26 user nova-compute[71347]: WARNING nova.compute.manager [req-9b0673f9-e07d-48be-87bc-aa86dcb0fc91 req-674b2b45-0520-4775-943c-d8881aa03299 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received unexpected event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 for instance with vm_state building and task_state spawning.
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482206.2478619, d9de3e2a-3325-4bc9-bfb3-9388a620abaf => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:23:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] VM Resumed (Lifecycle Event)
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:23:26 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Instance spawned successfully.
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:23:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482206.2510378, d9de3e2a-3325-4bc9-bfb3-9388a620abaf => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:23:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] VM Started (Lifecycle Event)
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:23:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:23:26 user nova-compute[71347]: INFO nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Took 6.60 seconds to spawn the instance on the hypervisor.
Apr 14 14:23:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:26 user nova-compute[71347]: INFO nova.compute.manager [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Took 7.41 seconds to build instance.
Apr 14 14:23:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ed0fd70-4e2f-43af-87a2-757fb96cb8d0 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.505s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid d9de3e2a-3325-4bc9-bfb3-9388a620abaf {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:37 user nova-compute[71347]: INFO nova.compute.manager [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Unrescuing
Apr 14 14:23:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquired lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:23:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482202.9794495, bc70d475-20dd-4859-a6fe-d2d09341799e => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:23:38 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] VM Stopped (Lifecycle Event)
Apr 14 14:23:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ff57c8ff-0739-4177-97aa-f3fb5ec39a7c None None] [instance: bc70d475-20dd-4859-a6fe-d2d09341799e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updating instance_info_cache with network_info: [{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Releasing lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'flavor' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:38 user nova-compute[71347]: WARNING nova.compute.manager [req-c8aa5e39-76a2-4cf9-961b-dba0eb61371f req-6236c32c-ca50-4b3d-857c-550ac577a872 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:23:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance destroyed successfully.
Apr 14 14:23:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-changed-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Refreshing instance network info cache due to event network-changed-fc6a8af0-4a67-4942-9548-41928d3f3f5d. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:23:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] Acquiring lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] Acquired lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Refreshing network info cache for port fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG nova.network.neutron [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updated VIF entry in instance network info cache for port fc6a8af0-4a67-4942-9548-41928d3f3f5d. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG nova.network.neutron [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1866ca6e-4c71-4fbe-889b-0f8b1850f7b1 req-ac695537-cfb9-4718-b164-875161c16148 service nova] Releasing lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:40 user nova-compute[71347]: INFO nova.compute.manager [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] instance snapshotting
Apr 14 14:23:40 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Beginning live snapshot process
Apr 14 14:23:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json -f qcow2 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:40 user nova-compute[71347]: WARNING nova.compute.manager [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:23:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:40 user nova-compute[71347]: WARNING nova.compute.manager [req-154f3206-f457-493c-bc2b-c99d3f48be53 req-4985d356-d973-40ed-834f-f5dbccf9feb7 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json -f qcow2 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1u4ouuwv/1d2825199f86499f889f949ade0cda02.delta 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1u4ouuwv/1d2825199f86499f889f949ade0cda02.delta 1073741824" returned: 0 in 0.047s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 14:23:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:23:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1u4ouuwv/1d2825199f86499f889f949ade0cda02.delta /opt/stack/data/nova/instances/snapshots/tmp1u4ouuwv/1d2825199f86499f889f949ade0cda02 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 30643f90-4347-4b1e-b1ca-57e69e716fb4 due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482222.7233162, 30643f90-4347-4b1e-b1ca-57e69e716fb4 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:23:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] VM Resumed (Lifecycle Event)
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bc0ad37a-1d6f-45c9-a2e4-d6e415e7e4ff tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:23:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482222.7718303, 30643f90-4347-4b1e-b1ca-57e69e716fb4 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:23:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] VM Started (Lifecycle Event)
Apr 14 14:23:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1u4ouuwv/1d2825199f86499f889f949ade0cda02.delta /opt/stack/data/nova/instances/snapshots/tmp1u4ouuwv/1d2825199f86499f889f949ade0cda02" returned: 0 in 0.300s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Snapshot extracted, beginning image upload
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:42 user nova-compute[71347]: WARNING nova.compute.manager [req-40b4e9c2-6c52-4774-a64d-9300b3878726 req-8047f0e1-2d16-43dc-9ba4-fb50a42b41a5 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state active and task_state None.
Apr 14 14:23:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:45 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Snapshot image upload complete
Apr 14 14:23:45 user nova-compute[71347]: INFO nova.compute.manager [None req-47a1214c-0bf2-488f-b262-0e14c2fca322 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Took 4.52 seconds to snapshot the instance on the hypervisor.
Apr 14 14:23:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:52 user nova-compute[71347]: INFO nova.compute.manager [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Terminating instance
Apr 14 14:23:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:23:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-unplugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] No waiting events found dispatching network-vif-unplugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ee7733b-8333-439f-b007-8fc2899a5b7b req-93983f7b-4af0-4ee2-8346-63b46d17e97a service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-unplugged-839834af-8da2-4f1a-84c5-e0469c3679f5 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Instance destroyed successfully.
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.objects.instance [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'resources' on Instance uuid e81e92d6-b79e-46db-b69e-1f7584440287 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1743182580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1743182580',id=7,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtFgmxFsC73JI3EOJh01Vi6JhjHyCGpGBiOSuQtkbj5LzuB0w3biqviCjGuFN4y4RXRWYVOA71m7CX2sS0tv+XOQaF5SvRG09bebHIKCIKlHl28aGGTIvcDfXJMO71mjA==',key_name='tempest-keypair-394852903',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-im4193la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=e81e92d6-b79e-46db-b69e-1f7584440287,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "839834af-8da2-4f1a-84c5-e0469c3679f5", "address": "fa:16:3e:c9:08:26", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap839834af-8d", "ovs_interfaceid": "839834af-8da2-4f1a-84c5-e0469c3679f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG os_vif [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap839834af-8d, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:23:53 user nova-compute[71347]: INFO os_vif [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:08:26,bridge_name='br-int',has_traffic_filtering=True,id=839834af-8da2-4f1a-84c5-e0469c3679f5,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap839834af-8d')
Apr 14 14:23:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Deleting instance files /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287_del
Apr 14 14:23:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Deletion of /opt/stack/data/nova/instances/e81e92d6-b79e-46db-b69e-1f7584440287_del complete
Apr 14 14:23:53 user nova-compute[71347]: INFO nova.compute.manager [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Took 1.00 seconds to destroy the instance on the hypervisor.
Apr 14 14:23:53 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:23:53 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:54 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Took 0.97 seconds to deallocate network for instance.
Apr 14 14:23:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:54 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:55 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:23:55 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:23:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Acquiring lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] Lock "e81e92d6-b79e-46db-b69e-1f7584440287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] No waiting events found dispatching network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:23:55 user nova-compute[71347]: WARNING nova.compute.manager [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received unexpected event network-vif-plugged-839834af-8da2-4f1a-84c5-e0469c3679f5 for instance with vm_state deleted and task_state None.
Apr 14 14:23:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-432167a0-0899-49bd-a7b9-9b028146990b req-999e74dc-bbf6-4ceb-8c4a-16d631a83f6a service nova] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Received event network-vif-deleted-839834af-8da2-4f1a-84c5-e0469c3679f5 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:55 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Deleted allocations for instance e81e92d6-b79e-46db-b69e-1f7584440287
Apr 14 14:23:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6e155a06-fecf-43b2-a848-0e29c7712c5c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "e81e92d6-b79e-46db-b69e-1f7584440287" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.553s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:56 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:23:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:23:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:23:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:23:56 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-changed-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Refreshing instance network info cache due to event network-changed-693b3793-ec24-4c90-ba05-73d5e4eaa30f. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] Acquiring lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] Acquired lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG nova.network.neutron [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Refreshing network info cache for port 693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG nova.network.neutron [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updated VIF entry in instance network info cache for port 693b3793-ec24-4c90-ba05-73d5e4eaa30f. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG nova.network.neutron [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updating instance_info_cache with network_info: [{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ed96aff7-c867-4c28-b49b-e3d462b3da7d req-6ebb3cf1-c821-4fce-9047-615e1d5b1ff9 service nova] Releasing lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:23:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:00 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:24:00 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7636MB free_disk=26.52261734008789GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 201765ec-21d3-4a0e-89f0-ece907f350bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fafce4d3-18c4-4f15-af62-e599c7749efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:00 user nova-compute[71347]: INFO nova.compute.manager [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Detaching volume fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:24:00 user nova-compute[71347]: INFO nova.virt.block_device [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attempting to driver detach volume fc7bcb89-d102-4f4c-a94f-677aed86e109 from mountpoint /dev/vdb
Apr 14 14:24:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Attempting to detach device vdb from instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:24:01 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:24:01 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:24:01 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:24:01 user nova-compute[71347]:   <serial>fc7bcb89-d102-4f4c-a94f-677aed86e109</serial>
Apr 14 14:24:01 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 14:24:01 user nova-compute[71347]: </disk>
Apr 14 14:24:01 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:24:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully detached device vdb from instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e from the persistent domain config.
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:24:01 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:24:01 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:24:01 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:24:01 user nova-compute[71347]:   <serial>fc7bcb89-d102-4f4c-a94f-677aed86e109</serial>
Apr 14 14:24:01 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 14:24:01 user nova-compute[71347]: </disk>
Apr 14 14:24:01 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.objects.instance [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:01 user nova-compute[71347]: INFO nova.compute.manager [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Attaching volume 7c4e8847-0aac-4a87-8a83-09a33dabcca1 to /dev/vdb
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.utils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8455bdeb-3910-4bba-b9f0-b8930c167ca4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a43620-f6f3-43f0-bf1e-b2dc850c94c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f70312-c3d3-4a22-ab03-fd642439cf75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[871924ce-0ced-43f6-bbf9-6b0ff88cf322]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482241.468013, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully detached device vdb from instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e from the live domain config.
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdaIglY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:24:01 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:24:01 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[85afcaa7-cee2-4906-9fbe-d8a204b35eca]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.utils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updating existing volume attachment record: f27b11ca-d0d7-4c5b-8cb7-b3d36dc1cf82 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9dca44-2e7e-4a11-9f29-be31c485e0ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:24:01 user nova-compute[71347]: No targets found.
Apr 14 14:24:01 user nova-compute[71347]: iSNS:
Apr 14 14:24:01 user nova-compute[71347]: No targets found.
Apr 14 14:24:01 user nova-compute[71347]: STATIC:
Apr 14 14:24:01 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109
Apr 14 14:24:01 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:24:01 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:24:01 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696
Apr 14 14:24:01 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:24:01 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:24:01 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431
Apr 14 14:24:01 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:24:01 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:24:01 user nova-compute[71347]: FIRMWARE:
Apr 14 14:24:01 user nova-compute[71347]: No targets found.
Apr 14 14:24:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:24:01 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:24:01 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17c0c0a-fcdd-4a74-9515-b6f51524bc1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[68172f9e-bcb3-46e3-98a0-562292219d9d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:24:01 user nova-compute[71347]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:24:01 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:24:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 (non-flash)
Apr 14 14:24:01 user nova-compute[71347]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:24:01 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:24:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f500770f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[063cdfcc-38b7-4745-a750-ffde266d75b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b9f05f-1719-4411-a3d3-284da2cec3f8]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffd747c-661b-46c8-8919-0b1688ad17e1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad6644a-e8c1-454a-8a68-540a4a6cf004]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c3847c-89c1-464c-a860-2437c8985441]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[178ae19b-0c80-4fbf-814a-6a5d36be6999]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260]
Apr 14 14:24:01 user nova-compute[71347]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109, portal: 172.16.0.220,3260] successful.
Apr 14 14:24:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc7bcb89-d102-4f4c-a94f-677aed86e109 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db78922-d3b6-4703-b1e7-beeb1efca6c3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== disconnect_volume: return (299ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:24:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:06 user nova-compute[71347]: DEBUG nova.objects.instance [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'flavor' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:24:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-509eb193-a6aa-4ea7-b589-3b1a16e0fce4 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.955s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFmzIspV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:24:07 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:24:07 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:24:07 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e33301-524c-420d-bd42-115102d72bb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:24:07 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[faefe963-4c03-4ea4-9cba-530634ceaf95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1] added
Apr 14 14:24:07 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[400a1b3a-7c6a-4a86-b8c4-670dd08634be]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e43103-2586-4ee0-8ca9-c7b1477b2eaf]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NFmzIspV {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NFmzIspV" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a0be4-780a-4b7d-b6a6-da316faf6d08]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NFmzIspV'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d910d8-3f5e-49d4-8221-17c5f29fafeb]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7756290-977f-492e-9328-274237ed436d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cb609a-7aab-4661-b2cd-167d2bc04d96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260]
Apr 14 14:24:07 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260] successful.
Apr 14 14:24:07 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d975f2ee-d430-4c3c-80cb-0f206efab6fd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e642ebe-59ea-4084-ab48-772013d5ace9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:24:07 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[04798622-57d0-4bb2-a925-ab4f29051a48]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:24:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFmzIspV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23564393730626436', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564393730626436', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:24:08 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:24:08 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:24:08 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:24:08 user nova-compute[71347]:   <serial>7c4e8847-0aac-4a87-8a83-09a33dabcca1</serial>
Apr 14 14:24:08 user nova-compute[71347]: </disk>
Apr 14 14:24:08 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482233.7121005, e81e92d6-b79e-46db-b69e-1f7584440287 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:24:08 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] VM Stopped (Lifecycle Event)
Apr 14 14:24:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-08d8143a-2ee6-4330-811e-4cb675a8bd2a None None] [instance: e81e92d6-b79e-46db-b69e-1f7584440287] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:24:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No VIF found with MAC fa:16:3e:39:a0:32, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:24:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3d6f4092-654e-4d66-8d05-14652a4e8f3a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.685s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71347) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG nova.objects.instance [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:24:10 user nova-compute[71347]: WARNING nova.compute.manager [req-ff2920c6-67cc-4a88-a6d4-618bbc5a8992 req-49e6c417-d1b4-4b28-b539-e7ea4ae72ad8 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state active and task_state powering-off.
Apr 14 14:24:10 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance destroyed successfully.
Apr 14 14:24:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-765a58d9-15a7-4c1b-99c0-605d86e51708 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.886s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:24:12 user nova-compute[71347]: WARNING nova.compute.manager [req-7a8cc143-2953-462c-aa38-2fd50f445aed req-f3e05c34-a06f-49dd-b247-26768ba3c9a0 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state stopped and task_state None.
Apr 14 14:24:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:25 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482250.9849586, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:24:25 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Stopped (Lifecycle Event)
Apr 14 14:24:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-9ffff53a-694c-406c-9d46-ff1f9853131c None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-9ffff53a-694c-406c-9d46-ff1f9853131c None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:24:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:24:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:24:41 user nova-compute[71347]: INFO nova.compute.claims [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Claim successful on node user
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:24:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:24:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Creating image(s)
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "/opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "/opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG nova.policy [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2de5e6883ff54d049fba7810fe4f1f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6ef742f6534538a9452fe0d4ddce56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk 1073741824" returned: 0 in 0.056s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Cannot resize image /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG nova.objects.instance [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lazy-loading 'migration_context' on Instance uuid 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Ensure instance console log exists: /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:42 user nova-compute[71347]: DEBUG nova.network.neutron [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Successfully created port: 0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Successfully updated port: 0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "refresh_cache-2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquired lock "refresh_cache-2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received event network-changed-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Refreshing instance network info cache due to event network-changed-0868ae2e-a499-4b0c-9257-ba38f3faa8c0. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] Acquiring lock "refresh_cache-2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Updating instance_info_cache with network_info: [{"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Releasing lock "refresh_cache-2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Instance network_info: |[{"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] Acquired lock "refresh_cache-2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.neutron [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Refreshing network info cache for port 0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Start _get_guest_xml network_info=[{"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:24:43 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:24:43 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1102932524',display_name='tempest-VolumesActionsTest-instance-1102932524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1102932524',id=21,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd6ef742f6534538a9452fe0d4ddce56',ramdisk_id='',reservation_id='r-jpg66nt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1447608595',owner_user_name='tempest-VolumesActionsTest-1447608595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:24:42Z,user_data=None,user_id='2de5e6883ff54d049fba7810fe4f1f38',uuid=2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converting VIF {"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:90,bridge_name='br-int',has_traffic_filtering=True,id=0868ae2e-a499-4b0c-9257-ba38f3faa8c0,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0868ae2e-a4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.objects.instance [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:24:43 user nova-compute[71347]:   <uuid>2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0</uuid>
Apr 14 14:24:43 user nova-compute[71347]:   <name>instance-00000015</name>
Apr 14 14:24:43 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:24:43 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:24:43 user nova-compute[71347]:   <metadata>
Apr 14 14:24:43 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:24:43 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:24:43 user nova-compute[71347]:       <nova:name>tempest-VolumesActionsTest-instance-1102932524</nova:name>
Apr 14 14:24:43 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:24:43</nova:creationTime>
Apr 14 14:24:43 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:24:43 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:24:43 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:24:43 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:24:43 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:24:43 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:24:43 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:24:43 user nova-compute[71347]:       <nova:owner>
Apr 14 14:24:43 user nova-compute[71347]:         <nova:user uuid="2de5e6883ff54d049fba7810fe4f1f38">tempest-VolumesActionsTest-1447608595-project-member</nova:user>
Apr 14 14:24:43 user nova-compute[71347]:         <nova:project uuid="cd6ef742f6534538a9452fe0d4ddce56">tempest-VolumesActionsTest-1447608595</nova:project>
Apr 14 14:24:43 user nova-compute[71347]:       </nova:owner>
Apr 14 14:24:43 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:24:43 user nova-compute[71347]:       <nova:ports>
Apr 14 14:24:43 user nova-compute[71347]:         <nova:port uuid="0868ae2e-a499-4b0c-9257-ba38f3faa8c0">
Apr 14 14:24:43 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 14:24:43 user nova-compute[71347]:         </nova:port>
Apr 14 14:24:43 user nova-compute[71347]:       </nova:ports>
Apr 14 14:24:43 user nova-compute[71347]:     </nova:instance>
Apr 14 14:24:43 user nova-compute[71347]:   </metadata>
Apr 14 14:24:43 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:24:43 user nova-compute[71347]:     <system>
Apr 14 14:24:43 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:24:43 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:24:43 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:24:43 user nova-compute[71347]:       <entry name="serial">2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0</entry>
Apr 14 14:24:43 user nova-compute[71347]:       <entry name="uuid">2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0</entry>
Apr 14 14:24:43 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:24:43 user nova-compute[71347]:     </system>
Apr 14 14:24:43 user nova-compute[71347]:   </sysinfo>
Apr 14 14:24:43 user nova-compute[71347]:   <os>
Apr 14 14:24:43 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:24:43 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:24:43 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:24:43 user nova-compute[71347]:   </os>
Apr 14 14:24:43 user nova-compute[71347]:   <features>
Apr 14 14:24:43 user nova-compute[71347]:     <acpi/>
Apr 14 14:24:43 user nova-compute[71347]:     <apic/>
Apr 14 14:24:43 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:24:43 user nova-compute[71347]:   </features>
Apr 14 14:24:43 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:24:43 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:24:43 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:24:43 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:24:43 user nova-compute[71347]:   </clock>
Apr 14 14:24:43 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:24:43 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:24:43 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:24:43 user nova-compute[71347]:   </cpu>
Apr 14 14:24:43 user nova-compute[71347]:   <devices>
Apr 14 14:24:43 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:24:43 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:24:43 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk"/>
Apr 14 14:24:43 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:24:43 user nova-compute[71347]:     </disk>
Apr 14 14:24:43 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:24:43 user nova-compute[71347]:       <mac address="fa:16:3e:15:dc:90"/>
Apr 14 14:24:43 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:24:43 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:24:43 user nova-compute[71347]:       <target dev="tap0868ae2e-a4"/>
Apr 14 14:24:43 user nova-compute[71347]:     </interface>
Apr 14 14:24:43 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:24:43 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/console.log" append="off"/>
Apr 14 14:24:43 user nova-compute[71347]:     </serial>
Apr 14 14:24:43 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:24:43 user nova-compute[71347]:     <video>
Apr 14 14:24:43 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:24:43 user nova-compute[71347]:     </video>
Apr 14 14:24:43 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:24:43 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:24:43 user nova-compute[71347]:     </rng>
Apr 14 14:24:43 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:24:43 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:24:43 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:24:43 user nova-compute[71347]:     </memballoon>
Apr 14 14:24:43 user nova-compute[71347]:   </devices>
Apr 14 14:24:43 user nova-compute[71347]: </domain>
Apr 14 14:24:43 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1102932524',display_name='tempest-VolumesActionsTest-instance-1102932524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1102932524',id=21,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd6ef742f6534538a9452fe0d4ddce56',ramdisk_id='',reservation_id='r-jpg66nt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1447608595',owner_user_name='tempest-VolumesActionsTest-1447608595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:24:42Z,user_data=None,user_id='2de5e6883ff54d049fba7810fe4f1f38',uuid=2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converting VIF {"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:90,bridge_name='br-int',has_traffic_filtering=True,id=0868ae2e-a499-4b0c-9257-ba38f3faa8c0,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0868ae2e-a4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG os_vif [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:90,bridge_name='br-int',has_traffic_filtering=True,id=0868ae2e-a499-4b0c-9257-ba38f3faa8c0,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0868ae2e-a4') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0868ae2e-a4, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0868ae2e-a4, col_values=(('external_ids', {'iface-id': '0868ae2e-a499-4b0c-9257-ba38f3faa8c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:dc:90', 'vm-uuid': '2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:43 user nova-compute[71347]: INFO os_vif [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:90,bridge_name='br-int',has_traffic_filtering=True,id=0868ae2e-a499-4b0c-9257-ba38f3faa8c0,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0868ae2e-a4')
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:24:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] No VIF found with MAC fa:16:3e:15:dc:90, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:24:44 user nova-compute[71347]: DEBUG nova.network.neutron [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Updated VIF entry in instance network info cache for port 0868ae2e-a499-4b0c-9257-ba38f3faa8c0. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:24:44 user nova-compute[71347]: DEBUG nova.network.neutron [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Updating instance_info_cache with network_info: [{"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:24:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-af7ae713-14ca-46e2-82d0-7718d6e73342 req-231a4849-5584-4875-b9f3-3735d82cf6aa service nova] Releasing lock "refresh_cache-2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:24:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received event network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] Acquiring lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] No waiting events found dispatching network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:24:45 user nova-compute[71347]: WARNING nova.compute.manager [req-a1eeb6ca-0132-4dbc-aa9c-6f1924eb37e8 req-5e725646-5704-4a42-85f2-90eed5d6d2fe service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received unexpected event network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance with vm_state building and task_state spawning.
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482287.522717, 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:24:47 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] VM Resumed (Lifecycle Event)
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:24:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Instance spawned successfully.
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:47 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482287.523254, 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:24:47 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] VM Started (Lifecycle Event)
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:24:47 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:24:47 user nova-compute[71347]: INFO nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Took 5.96 seconds to spawn the instance on the hypervisor.
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received event network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] Acquiring lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] No waiting events found dispatching network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:24:47 user nova-compute[71347]: WARNING nova.compute.manager [req-2a6a713c-22ff-4638-85b0-35078105c51d req-88c02172-f47a-4148-ae73-d23a4bd36e77 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received unexpected event network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance with vm_state building and task_state spawning.
Apr 14 14:24:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:24:47 user nova-compute[71347]: INFO nova.compute.manager [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Took 6.68 seconds to build instance.
Apr 14 14:24:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-635b9691-474a-4b27-9476-4ebe8e603d59 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.775s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:24:47 user nova-compute[71347]: INFO nova.compute.claims [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Claim successful on node user
Apr 14 14:24:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:24:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.policy [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7a99d9a44334bfeb39f6684853f6844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8263321b4e34ea08350e97ac2a3a794', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:24:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Creating image(s)
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk 1073741824" returned: 0 in 0.049s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:24:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Cannot resize image /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'migration_context' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Ensure instance console log exists: /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Successfully created port: 72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Successfully updated port: 72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquired lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-changed-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Refreshing instance network info cache due to event network-changed-72fbb0dc-8b93-4cc7-8ddc-0f7853749614. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] Acquiring lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:24:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Releasing lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance network_info: |[{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] Acquired lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.network.neutron [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Refreshing network info cache for port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Start _get_guest_xml network_info=[{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:24:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:24:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1136227517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1136227517',id=22,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC39skeqyy/RTc2E6soubP86qzQn/9pjIW/1tJXv0fmp+gdA0Bxhni7OkdPTKsoLqOCieZ5vJZzWbW7TfycVdcSU7X4yS6qH4uWHDqSZ80Xuf9itLdPoLws4FAivnu+l1A==',key_name='tempest-keypair-428673856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-yy4znehp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'pci_devices' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:24:50 user nova-compute[71347]:   <uuid>c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e</uuid>
Apr 14 14:24:50 user nova-compute[71347]:   <name>instance-00000016</name>
Apr 14 14:24:50 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:24:50 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:24:50 user nova-compute[71347]:   <metadata>
Apr 14 14:24:50 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:24:50 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:24:50 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1136227517</nova:name>
Apr 14 14:24:50 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:24:50</nova:creationTime>
Apr 14 14:24:50 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:24:50 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:24:50 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:24:50 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:24:50 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:24:50 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:24:50 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:24:50 user nova-compute[71347]:       <nova:owner>
Apr 14 14:24:50 user nova-compute[71347]:         <nova:user uuid="a7a99d9a44334bfeb39f6684853f6844">tempest-AttachVolumeShelveTestJSON-1666709251-project-member</nova:user>
Apr 14 14:24:50 user nova-compute[71347]:         <nova:project uuid="b8263321b4e34ea08350e97ac2a3a794">tempest-AttachVolumeShelveTestJSON-1666709251</nova:project>
Apr 14 14:24:50 user nova-compute[71347]:       </nova:owner>
Apr 14 14:24:50 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:24:50 user nova-compute[71347]:       <nova:ports>
Apr 14 14:24:50 user nova-compute[71347]:         <nova:port uuid="72fbb0dc-8b93-4cc7-8ddc-0f7853749614">
Apr 14 14:24:50 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 14:24:50 user nova-compute[71347]:         </nova:port>
Apr 14 14:24:50 user nova-compute[71347]:       </nova:ports>
Apr 14 14:24:50 user nova-compute[71347]:     </nova:instance>
Apr 14 14:24:50 user nova-compute[71347]:   </metadata>
Apr 14 14:24:50 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:24:50 user nova-compute[71347]:     <system>
Apr 14 14:24:50 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:24:50 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:24:50 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:24:50 user nova-compute[71347]:       <entry name="serial">c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e</entry>
Apr 14 14:24:50 user nova-compute[71347]:       <entry name="uuid">c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e</entry>
Apr 14 14:24:50 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:24:50 user nova-compute[71347]:     </system>
Apr 14 14:24:50 user nova-compute[71347]:   </sysinfo>
Apr 14 14:24:50 user nova-compute[71347]:   <os>
Apr 14 14:24:50 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:24:50 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:24:50 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:24:50 user nova-compute[71347]:   </os>
Apr 14 14:24:50 user nova-compute[71347]:   <features>
Apr 14 14:24:50 user nova-compute[71347]:     <acpi/>
Apr 14 14:24:50 user nova-compute[71347]:     <apic/>
Apr 14 14:24:50 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:24:50 user nova-compute[71347]:   </features>
Apr 14 14:24:50 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:24:50 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:24:50 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:24:50 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:24:50 user nova-compute[71347]:   </clock>
Apr 14 14:24:50 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:24:50 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:24:50 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:24:50 user nova-compute[71347]:   </cpu>
Apr 14 14:24:50 user nova-compute[71347]:   <devices>
Apr 14 14:24:50 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:24:50 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:24:50 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk"/>
Apr 14 14:24:50 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:24:50 user nova-compute[71347]:     </disk>
Apr 14 14:24:50 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:24:50 user nova-compute[71347]:       <mac address="fa:16:3e:ec:6c:a2"/>
Apr 14 14:24:50 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:24:50 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:24:50 user nova-compute[71347]:       <target dev="tap72fbb0dc-8b"/>
Apr 14 14:24:50 user nova-compute[71347]:     </interface>
Apr 14 14:24:50 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:24:50 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/console.log" append="off"/>
Apr 14 14:24:50 user nova-compute[71347]:     </serial>
Apr 14 14:24:50 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:24:50 user nova-compute[71347]:     <video>
Apr 14 14:24:50 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:24:50 user nova-compute[71347]:     </video>
Apr 14 14:24:50 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:24:50 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:24:50 user nova-compute[71347]:     </rng>
Apr 14 14:24:50 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:24:50 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:24:50 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:24:50 user nova-compute[71347]:     </memballoon>
Apr 14 14:24:50 user nova-compute[71347]:   </devices>
Apr 14 14:24:50 user nova-compute[71347]: </domain>
Apr 14 14:24:50 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1136227517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1136227517',id=22,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC39skeqyy/RTc2E6soubP86qzQn/9pjIW/1tJXv0fmp+gdA0Bxhni7OkdPTKsoLqOCieZ5vJZzWbW7TfycVdcSU7X4yS6qH4uWHDqSZ80Xuf9itLdPoLws4FAivnu+l1A==',key_name='tempest-keypair-428673856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-yy4znehp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG os_vif [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72fbb0dc-8b, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72fbb0dc-8b, col_values=(('external_ids', {'iface-id': '72fbb0dc-8b93-4cc7-8ddc-0f7853749614', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:6c:a2', 'vm-uuid': 'c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:50 user nova-compute[71347]: INFO os_vif [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b')
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:24:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No VIF found with MAC fa:16:3e:ec:6c:a2, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:24:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updated VIF entry in instance network info cache for port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:24:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:24:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bbe77195-48aa-4110-abad-ba35eb70ff3f req-e268d825-793e-4d20-8a2b-623e57a3a059 service nova] Releasing lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:24:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] No waiting events found dispatching network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:24:52 user nova-compute[71347]: WARNING nova.compute.manager [req-4b1c068c-b699-451a-a136-773aa315fe3a req-ce12de39-1d92-400e-8913-50a53bc7be29 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received unexpected event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance with vm_state building and task_state spawning.
Apr 14 14:24:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:24:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:24:53 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482293.983179, c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:24:53 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] VM Resumed (Lifecycle Event)
Apr 14 14:24:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance spawned successfully.
Apr 14 14:24:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:24:54 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482293.9866724, c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:24:54 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] VM Started (Lifecycle Event)
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:24:54 user nova-compute[71347]: INFO nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Took 5.67 seconds to spawn the instance on the hypervisor.
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:24:54 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:24:54 user nova-compute[71347]: INFO nova.compute.manager [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Took 6.42 seconds to build instance.
Apr 14 14:24:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f2c87b88-e764-41ae-be89-dc0963b3f8df tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.521s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] No waiting events found dispatching network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:24:54 user nova-compute[71347]: WARNING nova.compute.manager [req-f205063e-d4ea-46b5-89f0-bc9cd95fdce3 req-74ca4c31-6943-484f-a8cb-ad472f6f60a4 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received unexpected event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance with vm_state active and task_state None.
Apr 14 14:24:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:55 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-changed-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing instance network info cache due to event network-changed-cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] Acquiring lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] Acquired lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG nova.network.neutron [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing network info cache for port cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:24:58 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG nova.network.neutron [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updated VIF entry in instance network info cache for port cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG nova.network.neutron [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating instance_info_cache with network_info: [{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cef32f90-e5ef-4f30-b78e-9793bdabb150 req-179216f9-b2a8-4fb8-894f-1fbe5ad8b1f0 service nova] Releasing lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:24:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:00 user nova-compute[71347]: INFO nova.compute.manager [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Detaching volume 0591f14c-b6cc-477c-833e-ddb91e7bd431
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: INFO nova.virt.block_device [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Attempting to driver detach volume 0591f14c-b6cc-477c-833e-ddb91e7bd431 from mountpoint /dev/vdb
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Attempting to detach device vdb from instance 201765ec-21d3-4a0e-89f0-ece907f350bf from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:25:00 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:25:00 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:25:00 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:25:00 user nova-compute[71347]:   <serial>0591f14c-b6cc-477c-833e-ddb91e7bd431</serial>
Apr 14 14:25:00 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 14:25:00 user nova-compute[71347]: </disk>
Apr 14 14:25:00 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:25:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully detached device vdb from instance 201765ec-21d3-4a0e-89f0-ece907f350bf from the persistent domain config.
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 201765ec-21d3-4a0e-89f0-ece907f350bf from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:25:00 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:25:00 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:25:00 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:25:00 user nova-compute[71347]:   <serial>0591f14c-b6cc-477c-833e-ddb91e7bd431</serial>
Apr 14 14:25:00 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 14:25:00 user nova-compute[71347]: </disk>
Apr 14 14:25:00 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482300.635294, 201765ec-21d3-4a0e-89f0-ece907f350bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:25:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully detached device vdb from instance 201765ec-21d3-4a0e-89f0-ece907f350bf from the live domain config.
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxslJkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:25:00 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7cfb43-a1aa-456e-a959-d81793501f11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:25:00 user nova-compute[71347]: No targets found.
Apr 14 14:25:00 user nova-compute[71347]: iSNS:
Apr 14 14:25:00 user nova-compute[71347]: No targets found.
Apr 14 14:25:00 user nova-compute[71347]: STATIC:
Apr 14 14:25:00 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696
Apr 14 14:25:00 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:25:00 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:25:00 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431
Apr 14 14:25:00 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:25:00 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:25:00 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1
Apr 14 14:25:00 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:25:00 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:25:00 user nova-compute[71347]: FIRMWARE:
Apr 14 14:25:00 user nova-compute[71347]: No targets found.
Apr 14 14:25:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:25:00 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:25:00 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1495eff0-e172-4649-a3b5-3def3053a707]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2310e1c-d3c1-4a1e-8c67-a30957b814c7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:25:00 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:25:00 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:25:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 (non-flash)
Apr 14 14:25:00 user nova-compute[71347]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:25:00 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:25:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5007764790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f52b91d-5785-4ad7-9492-e11e8c4b4d51]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf48e3b-b8f4-450b-8e71-f017fdad99f5]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[552604ba-b705-46c6-9077-a097a43edc71]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1623f041-2806-46e2-9690-e60d354e8ef2]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-changed-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing instance network info cache due to event network-changed-cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] Acquiring lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] Acquired lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG nova.network.neutron [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Refreshing network info cache for port cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44b29ef-faba-406e-99fc-0249050cb4bf]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab6b148-ffa5-4686-80fc-5be2a723a743]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260]
Apr 14 14:25:01 user nova-compute[71347]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431, portal: 172.16.0.220,3260] successful.
Apr 14 14:25:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591f14c-b6cc-477c-833e-ddb91e7bd431 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b3ccae-ad08-49c0-89b1-66412d314a96]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] <== disconnect_volume: return (414ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG nova.network.neutron [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updated VIF entry in instance network info cache for port cc694601-d879-4214-ac40-2242faaec5bf. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG nova.network.neutron [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating instance_info_cache with network_info: [{"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-60d069ae-2e08-4af6-ad9f-cd4d76ad8ccd req-72676750-e75b-4c88-be2d-7c9cc21e123d service nova] Releasing lock "refresh_cache-201765ec-21d3-4a0e-89f0-ece907f350bf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'flavor' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-250d3b50-d322-4c42-a478-e0db49aeee6f tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.124s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:03 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:25:03 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7662MB free_disk=26.506641387939453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 201765ec-21d3-4a0e-89f0-ece907f350bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fafce4d3-18c4-4f15-af62-e599c7749efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:25:03 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:25:04 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:25:04 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:25:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updating instance_info_cache with network_info: [{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:25:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-changed-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Refreshing instance network info cache due to event network-changed-50c5a068-52cf-43f3-8065-6ada257d3449. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] Acquiring lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] Acquired lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG nova.network.neutron [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Refreshing network info cache for port 50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:10 user nova-compute[71347]: INFO nova.compute.manager [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Terminating instance
Apr 14 14:25:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Updated VIF entry in instance network info cache for port 50c5a068-52cf-43f3-8065-6ada257d3449. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Updating instance_info_cache with network_info: [{"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3debc1f2-c80e-410e-a3fc-782066b529d0 req-ebfe7373-d221-4db1-b713-95bad5d55515 service nova] Releasing lock "refresh_cache-d9de3e2a-3325-4bc9-bfb3-9388a620abaf" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-unplugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] No waiting events found dispatching network-vif-unplugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-802e5bd6-1e44-45b2-b1a8-ac86de0fc47f req-abe42e9c-18db-4287-82b6-d8426b52c0e6 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-unplugged-50c5a068-52cf-43f3-8065-6ada257d3449 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Instance destroyed successfully.
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.objects.instance [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'resources' on Instance uuid d9de3e2a-3325-4bc9-bfb3-9388a620abaf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2116395706',display_name='tempest-AttachVolumeNegativeTest-server-2116395706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2116395706',id=20,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESnavlENNjfXDBBjXZH0TsbH9EKMFE+T6Mpv2iIokkBQmdhZm5u1mpWFB6kBhDC2cGq5kV6NVzXAe9L+Fdg5KFHQcqHOskojjP9fpyzYiJBlhppafU1+xltOvvYIodn/w==',key_name='tempest-keypair-630351444',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:23:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-91nr5cq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=d9de3e2a-3325-4bc9-bfb3-9388a620abaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "50c5a068-52cf-43f3-8065-6ada257d3449", "address": "fa:16:3e:a3:85:61", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c5a068-52", "ovs_interfaceid": "50c5a068-52cf-43f3-8065-6ada257d3449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:61,bridge_name='br-int',has_traffic_filtering=True,id=50c5a068-52cf-43f3-8065-6ada257d3449,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c5a068-52') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG os_vif [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:61,bridge_name='br-int',has_traffic_filtering=True,id=50c5a068-52cf-43f3-8065-6ada257d3449,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c5a068-52') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50c5a068-52, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: INFO os_vif [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:61,bridge_name='br-int',has_traffic_filtering=True,id=50c5a068-52cf-43f3-8065-6ada257d3449,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c5a068-52')
Apr 14 14:25:11 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Deleting instance files /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf_del
Apr 14 14:25:11 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Deletion of /opt/stack/data/nova/instances/d9de3e2a-3325-4bc9-bfb3-9388a620abaf_del complete
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: INFO nova.compute.manager [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 14 14:25:11 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:25:13 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Took 1.53 seconds to deallocate network for instance.
Apr 14 14:25:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] No waiting events found dispatching network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:13 user nova-compute[71347]: WARNING nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received unexpected event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 for instance with vm_state deleted and task_state None.
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] No waiting events found dispatching network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:13 user nova-compute[71347]: WARNING nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received unexpected event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 for instance with vm_state deleted and task_state None.
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] No waiting events found dispatching network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:13 user nova-compute[71347]: WARNING nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received unexpected event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 for instance with vm_state deleted and task_state None.
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-unplugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] No waiting events found dispatching network-vif-unplugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:13 user nova-compute[71347]: WARNING nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received unexpected event network-vif-unplugged-50c5a068-52cf-43f3-8065-6ada257d3449 for instance with vm_state deleted and task_state None.
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Acquiring lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] No waiting events found dispatching network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:13 user nova-compute[71347]: WARNING nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received unexpected event network-vif-plugged-50c5a068-52cf-43f3-8065-6ada257d3449 for instance with vm_state deleted and task_state None.
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ceb8ec4-b57a-4f1e-8423-c7d37be1b612 req-bf661c27-5a25-4b49-a250-e82bcc90b1f7 service nova] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Received event network-vif-deleted-50c5a068-52cf-43f3-8065-6ada257d3449 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:13 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Deleted allocations for instance d9de3e2a-3325-4bc9-bfb3-9388a620abaf
Apr 14 14:25:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8d7d9e97-b182-456f-a1fe-ba051246b34a tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "d9de3e2a-3325-4bc9-bfb3-9388a620abaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.781s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:26 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482311.3392942, d9de3e2a-3325-4bc9-bfb3-9388a620abaf => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:25:26 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] VM Stopped (Lifecycle Event)
Apr 14 14:25:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4b95c1f3-5881-4d71-baa9-0580d2029b8e None None] [instance: d9de3e2a-3325-4bc9-bfb3-9388a620abaf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:25:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG nova.objects.instance [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'flavor' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:25:34 user nova-compute[71347]: INFO nova.compute.claims [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Claim successful on node user
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:34 user nova-compute[71347]: INFO nova.compute.manager [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Attaching volume ee4fd548-c01c-41ed-a231-433d83cb29da to /dev/vdb
Apr 14 14:25:34 user nova-compute[71347]: DEBUG os_brick.utils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[646835c5-3a93-4144-8d96-8a4bf72404aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f1564c-dd79-4f0a-9985-b180164bbd49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a0138e-4054-4ef2-9081-b542afad62a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96f4cdb-36ec-4bf4-aa77-eca6cae9afc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:25:34 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:25:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f901175f-3abb-46e1-a91e-d0913181738e]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG os_brick.utils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:25:34 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating existing volume attachment record: 58d5a849-8de2-4d03-8894-372a558e2c76 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:25:35 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.policy [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdfcb787b0f545f8b19e947d54d07b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53efd997e3e47d898264dae8a27a5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:25:35 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Creating image(s)
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.180s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk 1073741824" returned: 0 in 0.075s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.158s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Cannot resize image /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'migration_context' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Ensure instance console log exists: /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:36 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Successfully created port: 72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Successfully updated port: 72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquired lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-changed-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Refreshing instance network info cache due to event network-changed-72e0d4cc-2ecb-438e-97d0-faf165fef862. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] Acquiring lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:25:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating instance_info_cache with network_info: [{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Releasing lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance network_info: |[{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] Acquired lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Refreshing network info cache for port 72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Start _get_guest_xml network_info=[{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:25:38 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:25:38 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056227109',display_name='tempest-ServerRescueNegativeTestJSON-server-2056227109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056227109',id=23,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPuRsvBsGHusqtnaC8Oj9LBXgh3nY9LkQ3OL84XGLcTKFxNlys1/HBw5E8x0pZTchYk3yzjHgyDVXSLOySeUV4vk6BzjfyRxiyugq/K16fvubSEZS4xq2p9ZGyf7T/74w==',key_name='tempest-keypair-1178292711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-d3hey8gz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:25:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9a:e1,bridge_name='br-int',has_traffic_filtering=True,id=72e0d4cc-2ecb-438e-97d0-faf165fef862,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e0d4cc-2e') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'pci_devices' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:25:38 user nova-compute[71347]:   <uuid>fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b</uuid>
Apr 14 14:25:38 user nova-compute[71347]:   <name>instance-00000017</name>
Apr 14 14:25:38 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:25:38 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:25:38 user nova-compute[71347]:   <metadata>
Apr 14 14:25:38 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:25:38 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:25:38 user nova-compute[71347]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2056227109</nova:name>
Apr 14 14:25:38 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:25:38</nova:creationTime>
Apr 14 14:25:38 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:25:38 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:25:38 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:25:38 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:25:38 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:25:38 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:25:38 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:25:38 user nova-compute[71347]:       <nova:owner>
Apr 14 14:25:38 user nova-compute[71347]:         <nova:user uuid="cdfcb787b0f545f8b19e947d54d07b9c">tempest-ServerRescueNegativeTestJSON-1435712120-project-member</nova:user>
Apr 14 14:25:38 user nova-compute[71347]:         <nova:project uuid="b53efd997e3e47d898264dae8a27a5ad">tempest-ServerRescueNegativeTestJSON-1435712120</nova:project>
Apr 14 14:25:38 user nova-compute[71347]:       </nova:owner>
Apr 14 14:25:38 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:25:38 user nova-compute[71347]:       <nova:ports>
Apr 14 14:25:38 user nova-compute[71347]:         <nova:port uuid="72e0d4cc-2ecb-438e-97d0-faf165fef862">
Apr 14 14:25:38 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 14:25:38 user nova-compute[71347]:         </nova:port>
Apr 14 14:25:38 user nova-compute[71347]:       </nova:ports>
Apr 14 14:25:38 user nova-compute[71347]:     </nova:instance>
Apr 14 14:25:38 user nova-compute[71347]:   </metadata>
Apr 14 14:25:38 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:25:38 user nova-compute[71347]:     <system>
Apr 14 14:25:38 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:25:38 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:25:38 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:25:38 user nova-compute[71347]:       <entry name="serial">fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b</entry>
Apr 14 14:25:38 user nova-compute[71347]:       <entry name="uuid">fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b</entry>
Apr 14 14:25:38 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:25:38 user nova-compute[71347]:     </system>
Apr 14 14:25:38 user nova-compute[71347]:   </sysinfo>
Apr 14 14:25:38 user nova-compute[71347]:   <os>
Apr 14 14:25:38 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:25:38 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:25:38 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:25:38 user nova-compute[71347]:   </os>
Apr 14 14:25:38 user nova-compute[71347]:   <features>
Apr 14 14:25:38 user nova-compute[71347]:     <acpi/>
Apr 14 14:25:38 user nova-compute[71347]:     <apic/>
Apr 14 14:25:38 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:25:38 user nova-compute[71347]:   </features>
Apr 14 14:25:38 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:25:38 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:25:38 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:25:38 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:25:38 user nova-compute[71347]:   </clock>
Apr 14 14:25:38 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:25:38 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:25:38 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:25:38 user nova-compute[71347]:   </cpu>
Apr 14 14:25:38 user nova-compute[71347]:   <devices>
Apr 14 14:25:38 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:25:38 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:25:38 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk"/>
Apr 14 14:25:38 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:25:38 user nova-compute[71347]:     </disk>
Apr 14 14:25:38 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:25:38 user nova-compute[71347]:       <mac address="fa:16:3e:2b:9a:e1"/>
Apr 14 14:25:38 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:25:38 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:25:38 user nova-compute[71347]:       <target dev="tap72e0d4cc-2e"/>
Apr 14 14:25:38 user nova-compute[71347]:     </interface>
Apr 14 14:25:38 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:25:38 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/console.log" append="off"/>
Apr 14 14:25:38 user nova-compute[71347]:     </serial>
Apr 14 14:25:38 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:25:38 user nova-compute[71347]:     <video>
Apr 14 14:25:38 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:25:38 user nova-compute[71347]:     </video>
Apr 14 14:25:38 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:25:38 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:25:38 user nova-compute[71347]:     </rng>
Apr 14 14:25:38 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:25:38 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:25:38 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:25:38 user nova-compute[71347]:     </memballoon>
Apr 14 14:25:38 user nova-compute[71347]:   </devices>
Apr 14 14:25:38 user nova-compute[71347]: </domain>
Apr 14 14:25:38 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056227109',display_name='tempest-ServerRescueNegativeTestJSON-server-2056227109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056227109',id=23,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPuRsvBsGHusqtnaC8Oj9LBXgh3nY9LkQ3OL84XGLcTKFxNlys1/HBw5E8x0pZTchYk3yzjHgyDVXSLOySeUV4vk6BzjfyRxiyugq/K16fvubSEZS4xq2p9ZGyf7T/74w==',key_name='tempest-keypair-1178292711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-d3hey8gz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:25:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9a:e1,bridge_name='br-int',has_traffic_filtering=True,id=72e0d4cc-2ecb-438e-97d0-faf165fef862,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e0d4cc-2e') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG os_vif [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9a:e1,bridge_name='br-int',has_traffic_filtering=True,id=72e0d4cc-2ecb-438e-97d0-faf165fef862,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e0d4cc-2e') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72e0d4cc-2e, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72e0d4cc-2e, col_values=(('external_ids', {'iface-id': '72e0d4cc-2ecb-438e-97d0-faf165fef862', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:9a:e1', 'vm-uuid': 'fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:38 user nova-compute[71347]: INFO os_vif [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:9a:e1,bridge_name='br-int',has_traffic_filtering=True,id=72e0d4cc-2ecb-438e-97d0-faf165fef862,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e0d4cc-2e')
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No VIF found with MAC fa:16:3e:2b:9a:e1, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updated VIF entry in instance network info cache for port 72e0d4cc-2ecb-438e-97d0-faf165fef862. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating instance_info_cache with network_info: [{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:25:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0d77071e-fbe8-4dc2-b0c4-3ab30a9b3d11 req-23004a0e-586c-4b34-933b-c235ef90f121 service nova] Releasing lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:39 user nova-compute[71347]: WARNING nova.compute.manager [req-12bf9811-7104-4b94-b344-f50c18d84625 req-32a93d1d-6eba-48ca-91ba-d836c6b318c5 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state building and task_state spawning.
Apr 14 14:25:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHpkVYlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:25:39 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:25:39 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:25:39 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[58602d0c-1c4a-4a66-96d0-c292d1225194]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:25:39 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5867150-d97a-4ddc-9df2-cbf38dc7509a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da] added
Apr 14 14:25:39 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed534076-a242-4611-887e-a96219a97be1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26daac6-020c-447d-9b5e-50196223699b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHpkVYlU {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHpkVYlU" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed71c3-a1f9-4eab-bf55-e1fb52ce643d]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QHpkVYlU'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f34d617-9732-430f-84ee-a1d0557fe47b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22b2db1-8fad-4a6c-94df-1ee02808f2f1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:25:40 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:25:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:25:40 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:25:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c456df71-c028-4751-baaa-8f2fa50088b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da, portal: 172.16.0.220,3260]
Apr 14 14:25:40 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da, portal: 172.16.0.220,3260] successful.
Apr 14 14:25:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0848a5c-97d2-4925-93b3-c4ad44074eb7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffd552b-e2cf-41ab-927c-6eae1de49d9d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:25:40 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:25:40 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:25:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:25:40 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:25:40 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:25:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9453266e-58f2-4e9b-8e15-f9b28fd83626]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHpkVYlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23965363063393962', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965363063393962', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'flavor' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:25:41 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:25:41 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:25:41 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:25:41 user nova-compute[71347]:   <serial>ee4fd548-c01c-41ed-a231-433d83cb29da</serial>
Apr 14 14:25:41 user nova-compute[71347]: </disk>
Apr 14 14:25:41 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No VIF found with MAC fa:16:3e:22:e2:92, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482341.684857, fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:25:41 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] VM Resumed (Lifecycle Event)
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:25:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance spawned successfully.
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:25:41 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482341.6930103, fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:25:41 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] VM Started (Lifecycle Event)
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8056ee00-9877-43db-aa65-3be9b5f8cdfa tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.135s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:41 user nova-compute[71347]: WARNING nova.compute.manager [req-ec41c8ba-f801-4b66-a4c2-0da6775e14b7 req-ae68f9a3-e7f0-48f7-8282-b00d3f9aeb8f service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state building and task_state spawning.
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:25:41 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:25:41 user nova-compute[71347]: INFO nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Took 6.30 seconds to spawn the instance on the hypervisor.
Apr 14 14:25:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:25:41 user nova-compute[71347]: INFO nova.compute.manager [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Took 7.36 seconds to build instance.
Apr 14 14:25:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c0535735-29b1-406c-b111-d32bbb582544 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.475s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:42 user nova-compute[71347]: INFO nova.compute.manager [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Rescuing
Apr 14 14:25:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:25:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquired lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:25:42 user nova-compute[71347]: DEBUG nova.network.neutron [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Releasing lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:43 user nova-compute[71347]: WARNING nova.compute.manager [req-3e64a33e-70d9-4eb9-a4c5-a82c98933c6e req-ba6df5d8-6767-4851-aed7-76b6d2957f5f service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state active and task_state rescuing.
Apr 14 14:25:43 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance destroyed successfully.
Apr 14 14:25:43 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Attempting a stable device rescue
Apr 14 14:25:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71347) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance directory exists: not creating {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 14:25:43 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Creating image(s)
Apr 14 14:25:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG nova.objects.instance [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "29c9329f524353f40519aafc70bd78fe70da1221" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "29c9329f524353f40519aafc70bd78fe70da1221" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221.part --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG nova.virt.images [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] 32a818ca-b377-4b5e-8903-b6cf62547d0f was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:25:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221.part /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221.part /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221.converted" returned: 0 in 0.367s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "29c9329f524353f40519aafc70bd78fe70da1221" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.357s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "29c9329f524353f40519aafc70bd78fe70da1221" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "29c9329f524353f40519aafc70bd78fe70da1221" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221 --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221,backing_fmt=raw /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221,backing_fmt=raw /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue" returned: 0 in 0.053s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "29c9329f524353f40519aafc70bd78fe70da1221" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.objects.instance [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'migration_context' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:45 user nova-compute[71347]: WARNING nova.compute.manager [req-5f51403b-5f48-4fe9-9725-a4b77e29cdfc req-ec241e0b-800b-4188-bd46-df785153ea90 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state active and task_state rescuing.
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Start _get_guest_xml network_info=[{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "vif_mac": "fa:16:3e:22:e2:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '32a818ca-b377-4b5e-8903-b6cf62547d0f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHpkVYlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '18a432a7-c206-4cf8-9718-7d5360d97f4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee4fd548-c01c-41ed-a231-433d83cb29da', 'serial': 'ee4fd548-c01c-41ed-a231-433d83cb29da'}, 'attachment_id': '58d5a849-8de2-4d03-8894-372a558e2c76', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.objects.instance [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'resources' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.objects.instance [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'numa_topology' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:45 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:25:45 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.objects.instance [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHpkVYlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:25:45 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:25:45 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:25:45 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c078ef1a-e66b-4fff-8776-8bd8be26464d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QHpkVYlU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 14:25:45 user nova-compute[71347]: node.name = iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da
Apr 14 14:25:45 user nova-compute[71347]: node.tpgt = -1
Apr 14 14:25:45 user nova-compute[71347]: node.startup = automatic
Apr 14 14:25:45 user nova-compute[71347]: node.leading_login = No
Apr 14 14:25:45 user nova-compute[71347]: iface.iscsi_ifacename = default
Apr 14 14:25:45 user nova-compute[71347]: iface.net_ifacename = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.ipaddress = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.prefix_len = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.hwaddress = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.transport_name = tcp
Apr 14 14:25:45 user nova-compute[71347]: iface.initiatorname = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.state = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.vlan_id = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.vlan_priority = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.vlan_state = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.iface_num = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.mtu = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.port = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.bootproto = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.subnet_mask = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.gateway = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.dhcp_alt_client_id = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.dhcp_dns = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.dhcp_learn_iqn = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.dhcp_vendor_id_state = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.dhcp_vendor_id = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.dhcp_slp_da = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.fragmentation = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.gratuitous_arp = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.incoming_forwarding = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.tos_state = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.tos = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.ttl = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.delayed_ack = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.tcp_nagle = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.tcp_wsf_state = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.tcp_wsf = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.tcp_timer_scale = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.tcp_timestamp = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.redirect = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.def_task_mgmt_timeout = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.header_digest = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.data_digest = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.immediate_data = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.initial_r2t = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.data_seq_inorder = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.data_pdu_inorder = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.erl = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.max_receive_data_len = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.first_burst_len = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.max_outstanding_r2t = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.max_burst_len = 0
Apr 14 14:25:45 user nova-compute[71347]: iface.chap_auth = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.bidi_chap = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.strict_login_compliance = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.discovery_auth = <empty>
Apr 14 14:25:45 user nova-compute[71347]: iface.discovery_logout = <empty>
Apr 14 14:25:45 user nova-compute[71347]: node.discovery_address = <empty>
Apr 14 14:25:45 user nova-compute[71347]: node.discovery_port = 0
Apr 14 14:25:45 user nova-compute[71347]: node.discovery_type = static
Apr 14 14:25:45 user nova-compute[71347]: node.session.initial_cmdsn = 0
Apr 14 14:25:45 user nova-compute[71347]: node.session.initial_login_retry_max = 8
Apr 14 14:25:45 user nova-compute[71347]: node.session.xmit_thread_priority = -20
Apr 14 14:25:45 user nova-compute[71347]: node.session.cmds_max = 128
Apr 14 14:25:45 user nova-compute[71347]: node.session.queue_depth = 32
Apr 14 14:25:45 user nova-compute[71347]: node.session.nr_sessions = 1
Apr 14 14:25:45 user nova-compute[71347]: node.session.auth.authmethod = CHAP
Apr 14 14:25:45 user nova-compute[71347]: node.session.auth.username = QHpkVYlU
Apr 14 14:25:45 user nova-compute[71347]: node.session.auth.password = ***
Apr 14 14:25:45 user nova-compute[71347]: node.session.auth.username_in = <empty>
Apr 14 14:25:45 user nova-compute[71347]: node.session.auth.password_in = <empty>
Apr 14 14:25:45 user nova-compute[71347]: node.session.auth.chap_algs = MD5
Apr 14 14:25:45 user nova-compute[71347]: node.session.timeo.replacement_timeout = 120
Apr 14 14:25:45 user nova-compute[71347]: node.session.err_timeo.abort_timeout = 15
Apr 14 14:25:45 user nova-compute[71347]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 14:25:45 user nova-compute[71347]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 14:25:45 user nova-compute[71347]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.FastAbort = Yes
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.InitialR2T = No
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.ImmediateData = Yes
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.MaxConnections = 1
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 14:25:45 user nova-compute[71347]: node.session.iscsi.ERL = 0
Apr 14 14:25:45 user nova-compute[71347]: node.session.scan = manual
Apr 14 14:25:45 user nova-compute[71347]: node.session.reopen_max = 0
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].address = 172.16.0.220
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].port = 3260
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].startup = manual
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].tcp.window_size = 524288
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].tcp.type_of_service = 0
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].timeo.logout_timeout = 15
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].timeo.login_timeout = 15
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].timeo.auth_timeout = 45
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].iscsi.DataDigest = None
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].iscsi.IFMarker = No
Apr 14 14:25:45 user nova-compute[71347]: node.conn[0].iscsi.OFMarker = No
Apr 14 14:25:45 user nova-compute[71347]: # END RECORD
Apr 14 14:25:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b227d9fe-38f7-4407-a4d0-5e240e314e33]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e58e2c2-c835-4d02-82c3-7e22151e205a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHpkVYlU {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHpkVYlU" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d3f14c-e478-4554-99ec-2a8791fbcb7b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QHpkVYlU'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df67393-82cd-491f-aec7-29476ac4efbc]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1218143d-d879-4ef5-9d02-bb9e006f691c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:25:45 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:25:45 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:25:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:25:45 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:25:45 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:25:45 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] HCTL ('33', '0', '0', 0) found on session 22 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4287e969-5d43-45cb-a42d-518f565c9cb3]: (4, ('0 0 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Searching for a device in session 22 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHpkVYlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23965363063393962', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965363063393962', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-393140121',display_name='tempest-ServerStableDeviceRescueTest-server-393140121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-393140121',id=18,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcG6CGdcPTxnc20cAT09PWltwZ9dV2VmciF9n8/6ntZku9choOWtWjG4TaYyDwwi97Q7GgJIEVXlDOgWGZq3YI+oL07LY/8GN78RAWAGwVdDlzGqza6dkL5xCOnG2giNA==',key_name='tempest-keypair-1665568620',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b661ed41a346a487e0b47ce2c2af13',ramdisk_id='',reservation_id='r-usawgxs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-339063849',owner_user_name='tempest-ServerStableDeviceRescueTest-339063849-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64d891eb758466888e7ca9550994511',uuid=18a432a7-c206-4cf8-9718-7d5360d97f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "vif_mac": "fa:16:3e:22:e2:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Converting VIF {"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "vif_mac": "fa:16:3e:22:e2:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:92,bridge_name='br-int',has_traffic_filtering=True,id=fc6a8af0-4a67-4942-9548-41928d3f3f5d,network=Network(eebad641-c9f2-4ff8-8655-6019ac289951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc6a8af0-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.objects.instance [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'pci_devices' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:25:45 user nova-compute[71347]:   <uuid>18a432a7-c206-4cf8-9718-7d5360d97f4e</uuid>
Apr 14 14:25:45 user nova-compute[71347]:   <name>instance-00000012</name>
Apr 14 14:25:45 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:25:45 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:25:45 user nova-compute[71347]:   <metadata>
Apr 14 14:25:45 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:25:45 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:25:45 user nova-compute[71347]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-393140121</nova:name>
Apr 14 14:25:45 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:25:45</nova:creationTime>
Apr 14 14:25:45 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:25:45 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:25:45 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:25:45 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:25:45 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:25:45 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:25:45 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:25:45 user nova-compute[71347]:       <nova:owner>
Apr 14 14:25:45 user nova-compute[71347]:         <nova:user uuid="f64d891eb758466888e7ca9550994511">tempest-ServerStableDeviceRescueTest-339063849-project-member</nova:user>
Apr 14 14:25:45 user nova-compute[71347]:         <nova:project uuid="08b661ed41a346a487e0b47ce2c2af13">tempest-ServerStableDeviceRescueTest-339063849</nova:project>
Apr 14 14:25:45 user nova-compute[71347]:       </nova:owner>
Apr 14 14:25:45 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:25:45 user nova-compute[71347]:       <nova:ports>
Apr 14 14:25:45 user nova-compute[71347]:         <nova:port uuid="fc6a8af0-4a67-4942-9548-41928d3f3f5d">
Apr 14 14:25:45 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 14:25:45 user nova-compute[71347]:         </nova:port>
Apr 14 14:25:45 user nova-compute[71347]:       </nova:ports>
Apr 14 14:25:45 user nova-compute[71347]:     </nova:instance>
Apr 14 14:25:45 user nova-compute[71347]:   </metadata>
Apr 14 14:25:45 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:25:45 user nova-compute[71347]:     <system>
Apr 14 14:25:45 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:25:45 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:25:45 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:25:45 user nova-compute[71347]:       <entry name="serial">18a432a7-c206-4cf8-9718-7d5360d97f4e</entry>
Apr 14 14:25:45 user nova-compute[71347]:       <entry name="uuid">18a432a7-c206-4cf8-9718-7d5360d97f4e</entry>
Apr 14 14:25:45 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:25:45 user nova-compute[71347]:     </system>
Apr 14 14:25:45 user nova-compute[71347]:   </sysinfo>
Apr 14 14:25:45 user nova-compute[71347]:   <os>
Apr 14 14:25:45 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:25:45 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:25:45 user nova-compute[71347]:   </os>
Apr 14 14:25:45 user nova-compute[71347]:   <features>
Apr 14 14:25:45 user nova-compute[71347]:     <acpi/>
Apr 14 14:25:45 user nova-compute[71347]:     <apic/>
Apr 14 14:25:45 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:25:45 user nova-compute[71347]:   </features>
Apr 14 14:25:45 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:25:45 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:25:45 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:25:45 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:25:45 user nova-compute[71347]:   </clock>
Apr 14 14:25:45 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:25:45 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:25:45 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:25:45 user nova-compute[71347]:   </cpu>
Apr 14 14:25:45 user nova-compute[71347]:   <devices>
Apr 14 14:25:45 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:25:45 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:25:45 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk"/>
Apr 14 14:25:45 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:25:45 user nova-compute[71347]:     </disk>
Apr 14 14:25:45 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:25:45 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:25:45 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:25:45 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:25:45 user nova-compute[71347]:       <serial>ee4fd548-c01c-41ed-a231-433d83cb29da</serial>
Apr 14 14:25:45 user nova-compute[71347]:     </disk>
Apr 14 14:25:45 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:25:45 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:25:45 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue"/>
Apr 14 14:25:45 user nova-compute[71347]:       <target dev="vdc" bus="virtio"/>
Apr 14 14:25:45 user nova-compute[71347]:       <boot order="1"/>
Apr 14 14:25:45 user nova-compute[71347]:     </disk>
Apr 14 14:25:45 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:25:45 user nova-compute[71347]:       <mac address="fa:16:3e:22:e2:92"/>
Apr 14 14:25:45 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:25:45 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:25:45 user nova-compute[71347]:       <target dev="tapfc6a8af0-4a"/>
Apr 14 14:25:45 user nova-compute[71347]:     </interface>
Apr 14 14:25:45 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:25:45 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/console.log" append="off"/>
Apr 14 14:25:45 user nova-compute[71347]:     </serial>
Apr 14 14:25:45 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:25:45 user nova-compute[71347]:     <video>
Apr 14 14:25:45 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:25:45 user nova-compute[71347]:     </video>
Apr 14 14:25:45 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:25:45 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:25:45 user nova-compute[71347]:     </rng>
Apr 14 14:25:45 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:25:45 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:25:45 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:25:45 user nova-compute[71347]:     </memballoon>
Apr 14 14:25:45 user nova-compute[71347]:   </devices>
Apr 14 14:25:45 user nova-compute[71347]: </domain>
Apr 14 14:25:45 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:25:45 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance destroyed successfully.
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:25:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] No VIF found with MAC fa:16:3e:22:e2:92, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:47 user nova-compute[71347]: WARNING nova.compute.manager [req-77f06390-dcc3-4484-9522-93d2dfdcb131 req-5d39daf5-cb4d-44bc-8d17-f56f7112d669 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state active and task_state rescuing.
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 18a432a7-c206-4cf8-9718-7d5360d97f4e due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482349.6047719, 18a432a7-c206-4cf8-9718-7d5360d97f4e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:25:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] VM Resumed (Lifecycle Event)
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-92572223-2066-4f80-805d-87e7d3a7beb6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:25:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482349.6065955, 18a432a7-c206-4cf8-9718-7d5360d97f4e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:25:49 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] VM Started (Lifecycle Event)
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:49 user nova-compute[71347]: WARNING nova.compute.manager [req-bdab1892-0541-4d0d-b9b6-689307c581c5 req-8d2d178f-78f6-400f-8bd8-bfc0e423322b service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state rescued and task_state None.
Apr 14 14:25:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:54 user nova-compute[71347]: INFO nova.compute.manager [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Terminating instance
Apr 14 14:25:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received event network-vif-unplugged-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] Acquiring lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] No waiting events found dispatching network-vif-unplugged-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-3f1b4369-c05d-4824-bc3c-76511294d0f8 req-663bac5f-6f1b-4dcf-83ee-70bdc04473b1 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received event network-vif-unplugged-af22d0f9-f6de-4604-90f0-833f831a7a37 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG nova.objects.instance [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'flavor' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Instance destroyed successfully.
Apr 14 14:25:55 user nova-compute[71347]: DEBUG nova.objects.instance [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lazy-loading 'resources' on Instance uuid 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2047783908',display_name='tempest-ServersNegativeTestJSON-server-2047783908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2047783908',id=4,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08dbbd3691924823b98d44b11508019e',ramdisk_id='',reservation_id='r-nn1l7cxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1373448962',owner_user_name='tempest-ServersNegativeTestJSON-1373448962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:17:21Z,user_data=None,user_id='a609ae82102a4ec994823e59f1a37378',uuid=0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converting VIF {"id": "af22d0f9-f6de-4604-90f0-833f831a7a37", "address": "fa:16:3e:b8:e8:ba", "network": {"id": "6dbfb18b-1c4c-42fe-8597-3b57e05446a2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1906906335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08dbbd3691924823b98d44b11508019e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf22d0f9-f6", "ovs_interfaceid": "af22d0f9-f6de-4604-90f0-833f831a7a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e8:ba,bridge_name='br-int',has_traffic_filtering=True,id=af22d0f9-f6de-4604-90f0-833f831a7a37,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf22d0f9-f6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG os_vif [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e8:ba,bridge_name='br-int',has_traffic_filtering=True,id=af22d0f9-f6de-4604-90f0-833f831a7a37,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf22d0f9-f6') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf22d0f9-f6, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:55 user nova-compute[71347]: INFO os_vif [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e8:ba,bridge_name='br-int',has_traffic_filtering=True,id=af22d0f9-f6de-4604-90f0-833f831a7a37,network=Network(6dbfb18b-1c4c-42fe-8597-3b57e05446a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf22d0f9-f6')
Apr 14 14:25:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Deleting instance files /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8_del
Apr 14 14:25:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Deletion of /opt/stack/data/nova/instances/0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8_del complete
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:55 user nova-compute[71347]: INFO nova.compute.manager [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attaching volume 4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 to /dev/vdb
Apr 14 14:25:55 user nova-compute[71347]: INFO nova.compute.manager [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG os_brick.utils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[673e313e-36fb-47fd-9ea8-52329e5fcec8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebaf808-1961-47cc-9f5c-162614b918f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[305db54d-d155-4b79-adfb-8bc03b87d8a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd05309-b4b4-43e2-970a-2bb7edd321c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:25:55 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:25:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4689ba19-da90-47b4-aa8e-a307ab1fc83e]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG os_brick.utils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:25:55 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating existing volume attachment record: 6510e435-fcd1-483e-a8d3-f0d00737cf89 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:25:56 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Took 0.65 seconds to deallocate network for instance.
Apr 14 14:25:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:56 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Deleted allocations for instance 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8
Apr 14 14:25:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5abb459-63cc-4db3-81b2-c6e94b6d68f8 tempest-ServersNegativeTestJSON-1373448962 tempest-ServersNegativeTestJSON-1373448962-project-member] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.141s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received event network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Acquiring lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] Lock "0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] No waiting events found dispatching network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:56 user nova-compute[71347]: WARNING nova.compute.manager [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received unexpected event network-vif-plugged-af22d0f9-f6de-4604-90f0-833f831a7a37 for instance with vm_state deleted and task_state None.
Apr 14 14:25:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-3a0a267d-88a2-4a42-8c2b-821fc61dddc5 req-fe045783-582c-4dcb-9d05-038fd3b419a6 service nova] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Received event network-vif-deleted-af22d0f9-f6de-4604-90f0-833f831a7a37 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:56 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:58 user nova-compute[71347]: INFO nova.compute.manager [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Terminating instance
Apr 14 14:25:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-unplugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] No waiting events found dispatching network-vif-unplugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-unplugged-cc694601-d879-4214-ac40-2242faaec5bf for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Acquiring lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:25:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] No waiting events found dispatching network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:25:58 user nova-compute[71347]: WARNING nova.compute.manager [req-9df6d02f-fe57-4e13-80e8-f2c5a0bf7a2e req-0b7fc287-5112-41ad-940c-46f8b5f578cb service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received unexpected event network-vif-plugged-cc694601-d879-4214-ac40-2242faaec5bf for instance with vm_state active and task_state deleting.
Apr 14 14:25:58 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Instance destroyed successfully.
Apr 14 14:25:58 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'resources' on Instance uuid 201765ec-21d3-4a0e-89f0-ece907f350bf {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:20:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-482352325',display_name='tempest-TestMinimumBasicScenario-server-482352325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-482352325',id=15,image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCxxTX8m3sMjnQj10SbCLU0c/Ymb1VjMlB32qA7VxA2M07x/CXWwPIkJsT/KA8EBVjTpbWmbxfVPBZXTWP3k4z2LdlrRlImx/6QWiz51uLgrOJ7Bz3Oub23zXIvs42WMg==',key_name='tempest-TestMinimumBasicScenario-2096424138',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-3jz3gczk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cb83aa4-680b-4b06-9ae7-13ba22013082',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:23:15Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=201765ec-21d3-4a0e-89f0-ece907f350bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "cc694601-d879-4214-ac40-2242faaec5bf", "address": "fa:16:3e:4f:47:62", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc694601-d8", "ovs_interfaceid": "cc694601-d879-4214-ac40-2242faaec5bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG os_vif [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc694601-d8, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:25:59 user nova-compute[71347]: INFO os_vif [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:47:62,bridge_name='br-int',has_traffic_filtering=True,id=cc694601-d879-4214-ac40-2242faaec5bf,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc694601-d8')
Apr 14 14:25:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Deleting instance files /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf_del
Apr 14 14:25:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Deletion of /opt/stack/data/nova/instances/201765ec-21d3-4a0e-89f0-ece907f350bf_del complete
Apr 14 14:25:59 user nova-compute[71347]: INFO nova.compute.manager [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:25:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid '201765ec-21d3-4a0e-89f0-ece907f350bf' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid '201765ec-21d3-4a0e-89f0-ece907f350bf' (instance-0000000f)
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:26:00 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:00 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:00 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f73558-ae54-4f1c-badd-005517daf68b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:26:00 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faa2ff9-5e1a-4426-b3ec-9c8b8e5f5b3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12] added
Apr 14 14:26:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a6c27b-78f7-4b2a-bc06-d72298cf5e8f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:00 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Took 1.17 seconds to deallocate network for instance.
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee82e37-0df2-4a29-a23c-9853ca08eaf7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQsUPvbJ {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQsUPvbJ" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8302bf52-fa0a-42f8-8bda-69ca30fbd422]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQsUPvbJ'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea4c26-95dd-4ef9-9058-b9d4a6ddea22]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c930e-e54b-4786-bbec-9db1262d4a02]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff3259-3453-462f-8470-ff53bce361e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]
Apr 14 14:26:00 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.
Apr 14 14:26:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[59728e97-d464-4e4e-8c5d-9e0dc440221c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7913eee-8f43-461a-aedd-752c39a0e76b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:00 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbadbdf3-a142-418d-a627-7b8049eca253]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:00 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Deleted allocations for instance 201765ec-21d3-4a0e-89f0-ece907f350bf
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b8f66c1e-56a4-4549-b592-738cfe7f2265 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "201765ec-21d3-4a0e-89f0-ece907f350bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.685s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquired lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'info_cache' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-b26edc4a-c19e-41ee-9351-7b87d5c6268d req-37d33b07-a569-42be-a08d-b3670c121268 service nova] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Received event network-vif-deleted-cc694601-d879-4214-ac40-2242faaec5bf {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23539326664386133', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539326664386133', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.objects.instance [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'flavor' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:26:01 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:26:01 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:26:01 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:26:01 user nova-compute[71347]:   <serial>4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12</serial>
Apr 14 14:26:01 user nova-compute[71347]: </disk>
Apr 14 14:26:01 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updating instance_info_cache with network_info: [{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Releasing lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance destroyed successfully.
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'resources' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_vif [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap693b3793-ec, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:26:01 user nova-compute[71347]: INFO os_vif [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec')
Apr 14 14:26:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFmzIspV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:26:01 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b773ed-035c-4055-b664-f3e148ec741f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:26:01 user nova-compute[71347]: No targets found.
Apr 14 14:26:01 user nova-compute[71347]: iSNS:
Apr 14 14:26:01 user nova-compute[71347]: No targets found.
Apr 14 14:26:01 user nova-compute[71347]: STATIC:
Apr 14 14:26:01 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da
Apr 14 14:26:01 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:01 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:01 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696
Apr 14 14:26:01 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:01 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:01 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:26:01 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:01 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:01 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1
Apr 14 14:26:01 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:01 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:01 user nova-compute[71347]: FIRMWARE:
Apr 14 14:26:01 user nova-compute[71347]: No targets found.
Apr 14 14:26:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:26:01 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:26:01 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf8a04f-bc67-47f4-887f-2545dc0ffbc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4dc6e7-d2df-4209-9eaf-425a3f50ee3b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:01 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:01 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:01 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:01 user nova-compute[71347]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:01 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:01 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4c15d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3706b6ab-a24a-4c17-99a9-f18a98994b27]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de0afc9-8bf2-4e6e-83f0-dadecbe3d9b7]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2afaf-ecf8-4611-bc6f-c802044c9eff]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:26:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.092s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5dd717-7941-41a9-bf5e-d4d93f107eb5]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No VIF found with MAC fa:16:3e:32:d4:b0, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50cbe28-150f-4cba-b1df-df325b3bdb5c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5556b2-d2ae-46dc-be30-2910838821e8]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260]
Apr 14 14:26:02 user nova-compute[71347]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260] successful.
Apr 14 14:26:02 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-97651824-b866-4273-b111-b7ac2db03e75 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.924s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[75672661-477b-4a14-bc1e-6dc11a8bcd60]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.531s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== disconnect_volume: return (532ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Start _get_guest_xml network_info=[{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFmzIspV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a3faeeb1-a50c-474b-b694-98c4d70435d5', 'attached_at': '', 'detached_at': '', 'volume_id': '7c4e8847-0aac-4a87-8a83-09a33dabcca1', 'serial': '7c4e8847-0aac-4a87-8a83-09a33dabcca1'}, 'attachment_id': 'f27b11ca-d0d7-4c5b-8cb7-b3d36dc1cf82', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'numa_topology' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:02 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:26:02 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFmzIspV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:26:02 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:02 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:02 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[910660c0-a191-4080-aaaa-811fa460adb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:26:02 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85228fe-f76b-42c5-adab-7c04da35c47c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1] added
Apr 14 14:26:02 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[656bc84a-d1f3-4183-bfd4-afbe8a7406f0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[810166b0-123e-43c7-82ce-394f1b32c521]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NFmzIspV {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NFmzIspV" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[843c9793-7893-42b0-bb6e-6d6db91cb8da]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NFmzIspV'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c862cc1-06cc-4e63-9617-56e7101e28ad]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7772a45-5293-4577-9e0a-10711e1be72a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:02 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:02 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:02 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:02 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:02 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:02 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[179912eb-7909-4c17-a91b-93eed7377cf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260]
Apr 14 14:26:02 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260] successful.
Apr 14 14:26:02 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:02 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:26:02 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:26:02 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7820MB free_disk=26.406742095947266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3545b353-86bd-4583-b13f-0f3dec9e8f78]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:03 user nova-compute[71347]: INFO nova.compute.manager [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Detaching volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f951799c-8154-4175-9733-87c3884a34c7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:03 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:03 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:03 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:03 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:03 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:03 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:03 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:03 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.664s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2051267a-3724-4347-bf9c-3c7c017b7d0b]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFmzIspV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:03 user nova-compute[71347]: INFO nova.virt.block_device [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Attempting to driver detach volume f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 from mountpoint /dev/vdb
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Attempting to detach device vdb from instance fafce4d3-18c4-4f15-af62-e599c7749efe from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:26:03 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:26:03 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:26:03 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:26:03 user nova-compute[71347]:   <serial>f8f8a6ce-1a76-4c0b-909c-96ff91ba5696</serial>
Apr 14 14:26:03 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:26:03 user nova-compute[71347]: </disk>
Apr 14 14:26:03 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fafce4d3-18c4-4f15-af62-e599c7749efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:26:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully detached device vdb from instance fafce4d3-18c4-4f15-af62-e599c7749efe from the persistent domain config.
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fafce4d3-18c4-4f15-af62-e599c7749efe from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:26:03 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:26:03 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:26:03 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:26:03 user nova-compute[71347]:   <serial>f8f8a6ce-1a76-4c0b-909c-96ff91ba5696</serial>
Apr 14 14:26:03 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:26:03 user nova-compute[71347]: </disk>
Apr 14 14:26:03 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482363.6530597, fafce4d3-18c4-4f15-af62-e599c7749efe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:26:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully detached device vdb from instance fafce4d3-18c4-4f15-af62-e599c7749efe from the live domain config.
Apr 14 14:26:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjMmeSnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:26:03 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.715s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== connect_volume: return (1717ms) {'type': 'block', 'scsi_wwn': '23564393730626436', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564393730626436', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.430s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21d8199-20d9-4728-bb82-994e275d194b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:26:04 user nova-compute[71347]: No targets found.
Apr 14 14:26:04 user nova-compute[71347]: iSNS:
Apr 14 14:26:04 user nova-compute[71347]: No targets found.
Apr 14 14:26:04 user nova-compute[71347]: STATIC:
Apr 14 14:26:04 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da
Apr 14 14:26:04 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:04 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:04 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696
Apr 14 14:26:04 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:04 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:04 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:26:04 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:04 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:04 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1
Apr 14 14:26:04 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:04 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:04 user nova-compute[71347]: FIRMWARE:
Apr 14 14:26:04 user nova-compute[71347]: No targets found.
Apr 14 14:26:04 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:26:04 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:26:04 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'pci_devices' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:26:04 user nova-compute[71347]:   <uuid>a3faeeb1-a50c-474b-b694-98c4d70435d5</uuid>
Apr 14 14:26:04 user nova-compute[71347]:   <name>instance-00000013</name>
Apr 14 14:26:04 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:26:04 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:26:04 user nova-compute[71347]:   <metadata>
Apr 14 14:26:04 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:26:04 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:26:04 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeTestJSON-server-398425278</nova:name>
Apr 14 14:26:04 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:26:02</nova:creationTime>
Apr 14 14:26:04 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:26:04 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:26:04 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:26:04 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:26:04 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:26:04 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:26:04 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:26:04 user nova-compute[71347]:       <nova:owner>
Apr 14 14:26:04 user nova-compute[71347]:         <nova:user uuid="303cb0475ae74f328ee503d1e9d1f652">tempest-AttachVolumeTestJSON-1787222284-project-member</nova:user>
Apr 14 14:26:04 user nova-compute[71347]:         <nova:project uuid="6dd9adda27714cf5b55203d8d76de05a">tempest-AttachVolumeTestJSON-1787222284</nova:project>
Apr 14 14:26:04 user nova-compute[71347]:       </nova:owner>
Apr 14 14:26:04 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:26:04 user nova-compute[71347]:       <nova:ports>
Apr 14 14:26:04 user nova-compute[71347]:         <nova:port uuid="693b3793-ec24-4c90-ba05-73d5e4eaa30f">
Apr 14 14:26:04 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 14:26:04 user nova-compute[71347]:         </nova:port>
Apr 14 14:26:04 user nova-compute[71347]:       </nova:ports>
Apr 14 14:26:04 user nova-compute[71347]:     </nova:instance>
Apr 14 14:26:04 user nova-compute[71347]:   </metadata>
Apr 14 14:26:04 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:26:04 user nova-compute[71347]:     <system>
Apr 14 14:26:04 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:26:04 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:26:04 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:26:04 user nova-compute[71347]:       <entry name="serial">a3faeeb1-a50c-474b-b694-98c4d70435d5</entry>
Apr 14 14:26:04 user nova-compute[71347]:       <entry name="uuid">a3faeeb1-a50c-474b-b694-98c4d70435d5</entry>
Apr 14 14:26:04 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:26:04 user nova-compute[71347]:     </system>
Apr 14 14:26:04 user nova-compute[71347]:   </sysinfo>
Apr 14 14:26:04 user nova-compute[71347]:   <os>
Apr 14 14:26:04 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:26:04 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:26:04 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:26:04 user nova-compute[71347]:   </os>
Apr 14 14:26:04 user nova-compute[71347]:   <features>
Apr 14 14:26:04 user nova-compute[71347]:     <acpi/>
Apr 14 14:26:04 user nova-compute[71347]:     <apic/>
Apr 14 14:26:04 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:26:04 user nova-compute[71347]:   </features>
Apr 14 14:26:04 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:26:04 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:26:04 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:26:04 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:26:04 user nova-compute[71347]:   </clock>
Apr 14 14:26:04 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:26:04 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:26:04 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:26:04 user nova-compute[71347]:   </cpu>
Apr 14 14:26:04 user nova-compute[71347]:   <devices>
Apr 14 14:26:04 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:26:04 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:26:04 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk"/>
Apr 14 14:26:04 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:26:04 user nova-compute[71347]:     </disk>
Apr 14 14:26:04 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:26:04 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:26:04 user nova-compute[71347]:       <source dev="/dev/sdd"/>
Apr 14 14:26:04 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:26:04 user nova-compute[71347]:       <serial>7c4e8847-0aac-4a87-8a83-09a33dabcca1</serial>
Apr 14 14:26:04 user nova-compute[71347]:     </disk>
Apr 14 14:26:04 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:26:04 user nova-compute[71347]:       <mac address="fa:16:3e:39:a0:32"/>
Apr 14 14:26:04 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:26:04 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:26:04 user nova-compute[71347]:       <target dev="tap693b3793-ec"/>
Apr 14 14:26:04 user nova-compute[71347]:     </interface>
Apr 14 14:26:04 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:26:04 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/console.log" append="off"/>
Apr 14 14:26:04 user nova-compute[71347]:     </serial>
Apr 14 14:26:04 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:26:04 user nova-compute[71347]:     <video>
Apr 14 14:26:04 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:26:04 user nova-compute[71347]:     </video>
Apr 14 14:26:04 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:26:04 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:26:04 user nova-compute[71347]:     </rng>
Apr 14 14:26:04 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:26:04 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:26:04 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:26:04 user nova-compute[71347]:     </memballoon>
Apr 14 14:26:04 user nova-compute[71347]:   </devices>
Apr 14 14:26:04 user nova-compute[71347]: </domain>
Apr 14 14:26:04 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[489fa479-63fb-45d9-8a89-96ae047df4e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[80189ca3-a70a-4f68-8b00-0f1f1f4c05cc]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:04 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:04 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:04 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:04 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 (non-flash)
Apr 14 14:26:04 user nova-compute[71347]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:04 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:04 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:04 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50077aeb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adb929b-e677-4097-a10b-b1f35db11996]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f27e001-2c2d-43c1-a436-169cfac9ca96]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[447eb6fe-4836-495a-af90-97dac74a13c0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f916e9c6-8cc5-4c69-a25c-867fc44965a8]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5ac8d2-db66-4ab9-b93b-d92e8c69486b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'trusted_certs' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Stashing vm_state: active {{(pid=71347) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dd0129-e2f9-4588-b4db-76299d972d95]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696, portal: 172.16.0.220,3260]
Apr 14 14:26:04 user nova-compute[71347]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696, portal: 172.16.0.220,3260] successful.
Apr 14 14:26:04 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8a6ce-1a76-4c0b-909c-96ff91ba5696 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1b23f7-d244-431f-a3be-5f76aa894e50]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== disconnect_volume: return (870ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_requests' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:26:04 user nova-compute[71347]: INFO nova.compute.claims [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Claim successful on node user
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'resources' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_devices' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Cannot resize image /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'migration_context' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:04 user nova-compute[71347]: INFO nova.compute.resource_tracker [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating resource usage from migration 14233289-b464-48b3-b656-68f2ba128891
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG os_vif [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap693b3793-ec, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap693b3793-ec, col_values=(('external_ids', {'iface-id': '693b3793-ec24-4c90-ba05-73d5e4eaa30f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:a0:32', 'vm-uuid': 'a3faeeb1-a50c-474b-b694-98c4d70435d5'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:26:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:04 user nova-compute[71347]: INFO os_vif [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec')
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.489s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:05 user nova-compute[71347]: INFO nova.compute.manager [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Migrating
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:05 user nova-compute[71347]: INFO nova.compute.rpcapi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updating instance_info_cache with network_info: [{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.objects.instance [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bdf394a4-ddae-4c93-a60f-01b932c8bcb1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.443s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Starting migrate_disk_and_power_off {{(pid=71347) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:06 user nova-compute[71347]: WARNING nova.compute.manager [req-afa5b985-2878-42f7-bab1-ecf48dd9af01 req-7cee99b9-54c9-4db1-af8f-a85859cca09b service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state resize_migrating.
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:06 user nova-compute[71347]: WARNING nova.compute.manager [req-cc93d689-a7c6-43bf-aaa9-d6727eba0773 req-865947de-df4f-4ceb-ba7f-6281b71f5bed service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state stopped and task_state powering-on.
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance destroyed successfully.
Apr 14 14:26:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:26:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:32:d4:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:32:d4:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_vif [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eb1d71a-d0, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:26:06 user nova-compute[71347]: INFO os_vif [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0')
Apr 14 14:26:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:26:06 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf3b983-52d7-4926-98ce-06305ac2cf2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:26:06 user nova-compute[71347]: No targets found.
Apr 14 14:26:06 user nova-compute[71347]: iSNS:
Apr 14 14:26:06 user nova-compute[71347]: No targets found.
Apr 14 14:26:06 user nova-compute[71347]: STATIC:
Apr 14 14:26:06 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da
Apr 14 14:26:06 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:06 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:06 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:26:06 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:06 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:06 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1
Apr 14 14:26:06 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:26:06 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:26:06 user nova-compute[71347]: FIRMWARE:
Apr 14 14:26:06 user nova-compute[71347]: No targets found.
Apr 14 14:26:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:26:06 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:26:06 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0130b4-18ce-4fc9-8f25-02372bd722a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0192500-7a6d-4f92-8619-b49086e67a1c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:06 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:06 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:06 user nova-compute[71347]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:06 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4eff880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bbd1c0-9d63-4cb1-8985-c1f8cacea2ad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32a9e0c-f5a7-45de-84b3-d6170f854f4b]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:26:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a81244-18ec-47d9-a5f5-061b1625bdab]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b08581-b85d-4f2d-a39c-f7fc1b4d7967]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ac245-4d96-41e0-8c6b-2c7afccb0530]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f8a07b-a18f-4594-8ee3-ed2d4904d4f1]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]
Apr 14 14:26:07 user nova-compute[71347]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.
Apr 14 14:26:07 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca35c12-ec4a-4a92-a3c1-5df0edeb2c04]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== disconnect_volume: return (306ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e_resize/disk /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "cp -r /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e_resize/disk /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk" returned: 0 in 0.242s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e_resize/disk.info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk.info {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "cp -r /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e_resize/disk.info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk.info" returned: 0 in 0.033s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:08 user nova-compute[71347]: WARNING nova.compute.manager [req-0069c11a-dd23-4fc2-a5c1-967c8b23073b req-b4d33f07-5f82-4cca-a789-db4449cd9911 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state resize_migrating.
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:08 user nova-compute[71347]: WARNING nova.compute.manager [req-58a3c35d-b71f-4c48-b05a-c49503c3852d req-23cfeb51-ff9c-42aa-83a7-b5fbd7a0a9d2 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state stopped and task_state powering-on.
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482368.628457, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Resumed (Lifecycle Event)
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:26:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance rebooted successfully.
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c033887b-9771-4c59-b59f-98f2c3a7be8a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:26:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482368.636773, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Started (Lifecycle Event)
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Port 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef binding to destination host user is already ACTIVE {{(pid=71347) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG nova.network.neutron [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG os_brick.utils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfc672c-e46b-4a5a-8383-1b11977e623c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c09d174-bd49-412d-ac4b-6ce1522c7f9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f319548c-4ed5-4fd1-b428-89bf33bc271a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b17e2-fdbb-41d8-b7c7-939629a33ca0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:26:09 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:26:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[710dccad-94c0-4231-a042-3696ccaf3cdd]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:26:09 user nova-compute[71347]: DEBUG os_brick.utils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:26:10 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482355.2733803, 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:10 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] VM Stopped (Lifecycle Event)
Apr 14 14:26:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-566cf9bf-5447-4e09-94da-1200c17e72f8 None None] [instance: 0d92fe4f-f1ac-49ef-8171-e25c2bd7ccb8] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:13 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482358.9907515, 201765ec-21d3-4a0e-89f0-ece907f350bf => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:13 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] VM Stopped (Lifecycle Event)
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-24cdb5e0-4b47-4cce-9ae9-f58ec307cb64 None None] [instance: 201765ec-21d3-4a0e-89f0-ece907f350bf] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Starting finish_migration {{(pid=71347) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance directory exists: not creating {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 14:26:14 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Creating image(s)
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'trusted_certs' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Cannot resize image /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Ensure instance console log exists: /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Start _get_guest_xml network_info=[{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:32:d4:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e', 'attached_at': '2023-04-14T14:26:14.000000', 'detached_at': '', 'volume_id': '4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'serial': '4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12'}, 'attachment_id': '9c3738f6-d131-4fb3-a8ec-4a03a15d779d', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:26:14 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:26:14 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:26:14 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:14 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:26:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:26:14 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8516ef2-bd3c-4306-8dc8-832805b3244d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:26:14 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5ee7d1-b0fe-48b5-b608-6527cf5c1c5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12] added
Apr 14 14:26:14 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd25a6b-4a20-4546-803e-7b3cd086cdee]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ad124c-002a-48bb-b821-c49dc2158441]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQsUPvbJ {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQsUPvbJ" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8645c9f6-b32c-4bdf-9643-8334aeaf1ec0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQsUPvbJ'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e29731-77a8-4838-8ca2-ac9a453f9795]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[90659f24-0d97-4304-9d08-c4901d487680]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:15 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:15 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdee5f8b-989b-4657-89ec-e84bbe699b0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]
Apr 14 14:26:15 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.
Apr 14 14:26:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db1ae06-24a1-4b0f-9e21-ef1e2dd4145a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f4f27-4bbd-4b26-8d2e-3bd3cd3d882d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:15 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:15 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:26:15 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:26:15 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:26:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a4f018-e41f-45fc-a8d1-761c6a5102cd]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:26:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23539326664386133', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539326664386133', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:32:d4:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:32:d4:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:26:16 user nova-compute[71347]:   <uuid>a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</uuid>
Apr 14 14:26:16 user nova-compute[71347]:   <name>instance-00000005</name>
Apr 14 14:26:16 user nova-compute[71347]:   <memory>196608</memory>
Apr 14 14:26:16 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:26:16 user nova-compute[71347]:   <metadata>
Apr 14 14:26:16 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:26:16 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:26:16 user nova-compute[71347]:       <nova:name>tempest-ServerActionsTestJSON-server-1012026360</nova:name>
Apr 14 14:26:16 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:26:14</nova:creationTime>
Apr 14 14:26:16 user nova-compute[71347]:       <nova:flavor name="m1.micro">
Apr 14 14:26:16 user nova-compute[71347]:         <nova:memory>192</nova:memory>
Apr 14 14:26:16 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:26:16 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:26:16 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:26:16 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:26:16 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:26:16 user nova-compute[71347]:       <nova:owner>
Apr 14 14:26:16 user nova-compute[71347]:         <nova:user uuid="797d2d1bff8e4b26afe7856e4c3877cf">tempest-ServerActionsTestJSON-932644409-project-member</nova:user>
Apr 14 14:26:16 user nova-compute[71347]:         <nova:project uuid="3b087f26a80045f3844873220a67a4e4">tempest-ServerActionsTestJSON-932644409</nova:project>
Apr 14 14:26:16 user nova-compute[71347]:       </nova:owner>
Apr 14 14:26:16 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:26:16 user nova-compute[71347]:       <nova:ports>
Apr 14 14:26:16 user nova-compute[71347]:         <nova:port uuid="2eb1d71a-d0d7-473d-9eef-b939fd4b55ef">
Apr 14 14:26:16 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:26:16 user nova-compute[71347]:         </nova:port>
Apr 14 14:26:16 user nova-compute[71347]:       </nova:ports>
Apr 14 14:26:16 user nova-compute[71347]:     </nova:instance>
Apr 14 14:26:16 user nova-compute[71347]:   </metadata>
Apr 14 14:26:16 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:26:16 user nova-compute[71347]:     <system>
Apr 14 14:26:16 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:26:16 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:26:16 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:26:16 user nova-compute[71347]:       <entry name="serial">a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</entry>
Apr 14 14:26:16 user nova-compute[71347]:       <entry name="uuid">a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</entry>
Apr 14 14:26:16 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:26:16 user nova-compute[71347]:     </system>
Apr 14 14:26:16 user nova-compute[71347]:   </sysinfo>
Apr 14 14:26:16 user nova-compute[71347]:   <os>
Apr 14 14:26:16 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:26:16 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:26:16 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:26:16 user nova-compute[71347]:   </os>
Apr 14 14:26:16 user nova-compute[71347]:   <features>
Apr 14 14:26:16 user nova-compute[71347]:     <acpi/>
Apr 14 14:26:16 user nova-compute[71347]:     <apic/>
Apr 14 14:26:16 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:26:16 user nova-compute[71347]:   </features>
Apr 14 14:26:16 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:26:16 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:26:16 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:26:16 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:26:16 user nova-compute[71347]:   </clock>
Apr 14 14:26:16 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:26:16 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:26:16 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:26:16 user nova-compute[71347]:   </cpu>
Apr 14 14:26:16 user nova-compute[71347]:   <devices>
Apr 14 14:26:16 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:26:16 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:26:16 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk"/>
Apr 14 14:26:16 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:26:16 user nova-compute[71347]:     </disk>
Apr 14 14:26:16 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:26:16 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:26:16 user nova-compute[71347]:       <source dev="/dev/sdc"/>
Apr 14 14:26:16 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:26:16 user nova-compute[71347]:       <serial>4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12</serial>
Apr 14 14:26:16 user nova-compute[71347]:     </disk>
Apr 14 14:26:16 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:26:16 user nova-compute[71347]:       <mac address="fa:16:3e:32:d4:b0"/>
Apr 14 14:26:16 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:26:16 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:26:16 user nova-compute[71347]:       <target dev="tap2eb1d71a-d0"/>
Apr 14 14:26:16 user nova-compute[71347]:     </interface>
Apr 14 14:26:16 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:26:16 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/console.log" append="off"/>
Apr 14 14:26:16 user nova-compute[71347]:     </serial>
Apr 14 14:26:16 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:26:16 user nova-compute[71347]:     <video>
Apr 14 14:26:16 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:26:16 user nova-compute[71347]:     </video>
Apr 14 14:26:16 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:26:16 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:26:16 user nova-compute[71347]:     </rng>
Apr 14 14:26:16 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:26:16 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:26:16 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:26:16 user nova-compute[71347]:     </memballoon>
Apr 14 14:26:16 user nova-compute[71347]:   </devices>
Apr 14 14:26:16 user nova-compute[71347]: </domain>
Apr 14 14:26:16 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:32:d4:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:32:d4:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG os_vif [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eb1d71a-d0, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eb1d71a-d0, col_values=(('external_ids', {'iface-id': '2eb1d71a-d0d7-473d-9eef-b939fd4b55ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:d4:b0', 'vm-uuid': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:16 user nova-compute[71347]: INFO os_vif [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0')
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:26:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No VIF found with MAC fa:16:3e:32:d4:b0, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:26:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:18 user nova-compute[71347]: DEBUG nova.compute.manager [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:18 user nova-compute[71347]: DEBUG nova.compute.manager [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:18 user nova-compute[71347]: WARNING nova.compute.manager [req-21f680e5-661c-48b2-b6bd-b57fadeeba10 req-fa382119-0839-4616-84cd-a7405e6ccb31 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state resize_finish.
Apr 14 14:26:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482380.052547, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Resumed (Lifecycle Event)
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:26:20 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance running successfully.
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Failed to set time: agent not configured {{(pid=71347) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-4c4fcc8b-4bde-45e7-b352-57198a10c8e5 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] finish_migration finished successfully. {{(pid=71347) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:26:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482380.054059, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Started (Lifecycle Event)
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.compute.manager [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:20 user nova-compute[71347]: WARNING nova.compute.manager [req-86177513-ddb8-43a5-923e-d4784a5db07b req-e1fc56d6-3af3-4d38-bc5a-6ce6ae7f8421 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state resize_finish.
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:26:20 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 14:26:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:31 user nova-compute[71347]: INFO nova.compute.manager [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Terminating instance
Apr 14 14:26:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received event network-vif-unplugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] Acquiring lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] No waiting events found dispatching network-vif-unplugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-e05c4c38-95cb-4f21-a5d5-65e8fe733e9b req-15b61bb2-8b8f-4dfb-b5b7-9fc3e9b7c8b0 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received event network-vif-unplugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:26:32 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Instance destroyed successfully.
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lazy-loading 'resources' on Instance uuid 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1102932524',display_name='tempest-VolumesActionsTest-instance-1102932524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1102932524',id=21,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:24:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd6ef742f6534538a9452fe0d4ddce56',ramdisk_id='',reservation_id='r-jpg66nt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1447608595',owner_user_name='tempest-VolumesActionsTest-1447608595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:24:48Z,user_data=None,user_id='2de5e6883ff54d049fba7810fe4f1f38',uuid=2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converting VIF {"id": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "address": "fa:16:3e:15:dc:90", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0868ae2e-a4", "ovs_interfaceid": "0868ae2e-a499-4b0c-9257-ba38f3faa8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:90,bridge_name='br-int',has_traffic_filtering=True,id=0868ae2e-a499-4b0c-9257-ba38f3faa8c0,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0868ae2e-a4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG os_vif [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:90,bridge_name='br-int',has_traffic_filtering=True,id=0868ae2e-a499-4b0c-9257-ba38f3faa8c0,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0868ae2e-a4') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0868ae2e-a4, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:26:32 user nova-compute[71347]: INFO os_vif [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:dc:90,bridge_name='br-int',has_traffic_filtering=True,id=0868ae2e-a499-4b0c-9257-ba38f3faa8c0,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0868ae2e-a4')
Apr 14 14:26:32 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Deleting instance files /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0_del
Apr 14 14:26:32 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Deletion of /opt/stack/data/nova/instances/2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0_del complete
Apr 14 14:26:32 user nova-compute[71347]: INFO nova.compute.manager [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 14:26:32 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:32 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Took 0.58 seconds to deallocate network for instance.
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received event network-vif-deleted-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:32 user nova-compute[71347]: INFO nova.compute.manager [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Neutron deleted interface 0868ae2e-a499-4b0c-9257-ba38f3faa8c0; detaching it from the instance and deleting it from the info cache
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.network.neutron [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-1bde7151-46d2-4bb8-8619-f36a06d65eea req-2bbfc520-bddb-40a7-b3ba-e5b27276c3a3 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Detach interface failed, port_id=0868ae2e-a499-4b0c-9257-ba38f3faa8c0, reason: Instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:33 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Deleted allocations for instance 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0
Apr 14 14:26:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a416b10-84e1-43e6-b437-1bbace5c9ba3 tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.748s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received event network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] Acquiring lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] Lock "2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] No waiting events found dispatching network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:33 user nova-compute[71347]: WARNING nova.compute.manager [req-a464931c-1780-476b-8820-48d57448e68d req-41825090-9b7c-4d13-be49-631f0733d9d9 service nova] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Received unexpected event network-vif-plugged-0868ae2e-a499-4b0c-9257-ba38f3faa8c0 for instance with vm_state deleted and task_state None.
Apr 14 14:26:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-changed-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Refreshing instance network info cache due to event network-changed-72fbb0dc-8b93-4cc7-8ddc-0f7853749614. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:26:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] Acquiring lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] Acquired lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Refreshing network info cache for port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:26:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updated VIF entry in instance network info cache for port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:26:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1387a82d-b042-4965-9f38-71fa5b1a7bc5 req-5a9b3b14-0771-4b58-8c29-fee62366abce service nova] Releasing lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:41 user nova-compute[71347]: INFO nova.compute.manager [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Shelving
Apr 14 14:26:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-unplugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] No waiting events found dispatching network-vif-unplugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:42 user nova-compute[71347]: WARNING nova.compute.manager [req-edfe6883-3ef9-4c3c-a384-232976561969 req-d605f017-0aa9-4fd0-9ee7-7ef785d4c6eb service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received unexpected event network-vif-unplugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance with vm_state active and task_state shelving.
Apr 14 14:26:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance destroyed successfully.
Apr 14 14:26:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Beginning cold snapshot process
Apr 14 14:26:42 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:26:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk /opt/stack/data/nova/instances/snapshots/tmpr6c9b04w/d402f4b9871e497ba64e4579daa29bd6 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk /opt/stack/data/nova/instances/snapshots/tmpr6c9b04w/d402f4b9871e497ba64e4579daa29bd6" returned: 0 in 0.568s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:43 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Snapshot extracted, beginning image upload
Apr 14 14:26:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] No waiting events found dispatching network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:44 user nova-compute[71347]: WARNING nova.compute.manager [req-d021c459-c0cf-4c51-b014-e2a91a93a67c req-13f26714-84ac-432c-8509-307871238b68 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received unexpected event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 14:26:45 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Snapshot image upload complete
Apr 14 14:26:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:45 user nova-compute[71347]: INFO nova.compute.manager [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Shelve offloading
Apr 14 14:26:45 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance destroyed successfully.
Apr 14 14:26:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquired lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:45 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:26:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Releasing lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482392.092826, 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:47 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] VM Stopped (Lifecycle Event)
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-77adb1fe-626a-469d-89b6-d6c27b462ceb None None] [instance: 2ea4bfad-ad4f-4f0d-a739-0af5408cbbc0] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance destroyed successfully.
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'resources' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1136227517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1136227517',id=22,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC39skeqyy/RTc2E6soubP86qzQn/9pjIW/1tJXv0fmp+gdA0Bxhni7OkdPTKsoLqOCieZ5vJZzWbW7TfycVdcSU7X4yS6qH4uWHDqSZ80Xuf9itLdPoLws4FAivnu+l1A==',key_name='tempest-keypair-428673856',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-yy4znehp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member',shelved_at='2023-04-14T14:26:45.501479',shelved_host='user',shelved_image_id='9781b14d-4bb9-43ad-a813-cbb59c6f8989'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG os_vif [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72fbb0dc-8b, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:26:47 user nova-compute[71347]: INFO os_vif [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b')
Apr 14 14:26:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Deleting instance files /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e_del
Apr 14 14:26:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Deletion of /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e_del complete
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-changed-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Refreshing instance network info cache due to event network-changed-72fbb0dc-8b93-4cc7-8ddc-0f7853749614. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] Acquiring lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] Acquired lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.network.neutron [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Refreshing network info cache for port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:26:47 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Deleted allocations for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e
Apr 14 14:26:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'numa_topology' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.network.neutron [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updated VIF entry in instance network info cache for port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG nova.network.neutron [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0a636f8b-bc54-44c7-a083-e0d50b73f47f tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.067s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-35ed4a09-1766-4f42-a510-c8ffa0180cc5 req-7d3d712e-4745-406d-b5a1-31b7d8d3182d service nova] Releasing lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:26:52 user nova-compute[71347]: INFO nova.compute.claims [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Claim successful on node user
Apr 14 14:26:52 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:26:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:26:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:26:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG nova.policy [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19dad04c158549c39991ea05fca2531d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df398dd4f844286b41ee4948001013a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:26:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Creating image(s)
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "/opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "/opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "c83b20313c9942ffcec13e8065bda03f67098027" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "c83b20313c9942ffcec13e8065bda03f67098027" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:53 user nova-compute[71347]: INFO nova.compute.manager [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Terminating instance
Apr 14 14:26:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027.part --force-share --output=json" returned: 0 in 0.171s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG nova.virt.images [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 9de2d251-ab11-4790-9d8b-f377d8e365bb was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027.part /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027.part /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027.converted" returned: 0 in 0.310s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Successfully created port: 017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received event network-vif-unplugged-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] No waiting events found dispatching network-vif-unplugged-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-a712b29d-9df4-44cf-b285-f7d4ee352fe8 req-dfd2385f-bf88-43cc-bb29-21b680c550c9 service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received event network-vif-unplugged-b3956c03-e69e-4181-940f-8e9e890b36ad for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "c83b20313c9942ffcec13e8065bda03f67098027" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.956s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027 --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "c83b20313c9942ffcec13e8065bda03f67098027" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "c83b20313c9942ffcec13e8065bda03f67098027" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:54 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Instance destroyed successfully.
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'resources' on Instance uuid fafce4d3-18c4-4f15-af62-e599c7749efe {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-136108581',display_name='tempest-AttachVolumeNegativeTest-server-136108581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-136108581',id=17,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXMBsx3tZ/pzA7pUesoxz20+s2PMIuu1p4YtORcW2KZpbK+XTk1V1E55dx88s1tlWtpe92mIcpEdZncR+F3HkdmfxQm3HyfeSnI5mqOcypLulfxZXvv2e/JzrsDckWZQA==',key_name='tempest-keypair-1691574866',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-ap5z90tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=fafce4d3-18c4-4f15-af62-e599c7749efe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "b3956c03-e69e-4181-940f-8e9e890b36ad", "address": "fa:16:3e:05:38:67", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3956c03-e6", "ovs_interfaceid": "b3956c03-e69e-4181-940f-8e9e890b36ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:38:67,bridge_name='br-int',has_traffic_filtering=True,id=b3956c03-e69e-4181-940f-8e9e890b36ad,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3956c03-e6') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG os_vif [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:38:67,bridge_name='br-int',has_traffic_filtering=True,id=b3956c03-e69e-4181-940f-8e9e890b36ad,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3956c03-e6') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3956c03-e6, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:26:54 user nova-compute[71347]: INFO os_vif [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:38:67,bridge_name='br-int',has_traffic_filtering=True,id=b3956c03-e69e-4181-940f-8e9e890b36ad,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3956c03-e6')
Apr 14 14:26:54 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Deleting instance files /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe_del
Apr 14 14:26:54 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Deletion of /opt/stack/data/nova/instances/fafce4d3-18c4-4f15-af62-e599c7749efe_del complete
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027 --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027,backing_fmt=raw /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027,backing_fmt=raw /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk 1073741824" returned: 0 in 0.051s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "c83b20313c9942ffcec13e8065bda03f67098027" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:54 user nova-compute[71347]: INFO nova.compute.manager [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Took 1.29 seconds to destroy the instance on the hypervisor.
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027 --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Cannot resize image /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'migration_context' on Instance uuid 5e419ecb-c1e3-4713-a190-62a7f220d01a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Ensure instance console log exists: /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Successfully updated port: 017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquired lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-changed-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing instance network info cache due to event network-changed-017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] Acquiring lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:26:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.neutron [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating instance_info_cache with network_info: [{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Releasing lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Instance network_info: |[{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] Acquired lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing network info cache for port 017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Start _get_guest_xml network_info=[{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:26:50Z,direct_url=<?>,disk_format='qcow2',id=9de2d251-ab11-4790-9d8b-f377d8e365bb,min_disk=0,min_ram=0,name='tempest-scenario-img--1548396072',owner='1df398dd4f844286b41ee4948001013a',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:26:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '9de2d251-ab11-4790-9d8b-f377d8e365bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:26:55 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:26:55 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:26:50Z,direct_url=<?>,disk_format='qcow2',id=9de2d251-ab11-4790-9d8b-f377d8e365bb,min_disk=0,min_ram=0,name='tempest-scenario-img--1548396072',owner='1df398dd4f844286b41ee4948001013a',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:26:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1608636042',display_name='tempest-TestMinimumBasicScenario-server-1608636042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1608636042',id=24,image_ref='9de2d251-ab11-4790-9d8b-f377d8e365bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLPNmyz5FZJ3JAXf567ogWCKZDDVaqr9sdsziyTaoW8c91s8+u4CUBY6blg8NMdt+y5NCYJ1EOsl2swnOrdXNwIidTwhVARRGFOvEPgRirEEdPwZP062lK/mCMIA4xsg==',key_name='tempest-TestMinimumBasicScenario-349171501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-y4b0kty0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9de2d251-ab11-4790-9d8b-f377d8e365bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:26:53Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=5e419ecb-c1e3-4713-a190-62a7f220d01a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e9:07,bridge_name='br-int',has_traffic_filtering=True,id=017c2389-4552-4847-9195-84fe74787c99,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017c2389-45') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.objects.instance [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e419ecb-c1e3-4713-a190-62a7f220d01a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:26:55 user nova-compute[71347]:   <uuid>5e419ecb-c1e3-4713-a190-62a7f220d01a</uuid>
Apr 14 14:26:55 user nova-compute[71347]:   <name>instance-00000018</name>
Apr 14 14:26:55 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:26:55 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:26:55 user nova-compute[71347]:   <metadata>
Apr 14 14:26:55 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:26:55 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:26:55 user nova-compute[71347]:       <nova:name>tempest-TestMinimumBasicScenario-server-1608636042</nova:name>
Apr 14 14:26:55 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:26:55</nova:creationTime>
Apr 14 14:26:55 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:26:55 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:26:55 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:26:55 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:26:55 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:26:55 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:26:55 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:26:55 user nova-compute[71347]:       <nova:owner>
Apr 14 14:26:55 user nova-compute[71347]:         <nova:user uuid="19dad04c158549c39991ea05fca2531d">tempest-TestMinimumBasicScenario-248098662-project-member</nova:user>
Apr 14 14:26:55 user nova-compute[71347]:         <nova:project uuid="1df398dd4f844286b41ee4948001013a">tempest-TestMinimumBasicScenario-248098662</nova:project>
Apr 14 14:26:55 user nova-compute[71347]:       </nova:owner>
Apr 14 14:26:55 user nova-compute[71347]:       <nova:root type="image" uuid="9de2d251-ab11-4790-9d8b-f377d8e365bb"/>
Apr 14 14:26:55 user nova-compute[71347]:       <nova:ports>
Apr 14 14:26:55 user nova-compute[71347]:         <nova:port uuid="017c2389-4552-4847-9195-84fe74787c99">
Apr 14 14:26:55 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:26:55 user nova-compute[71347]:         </nova:port>
Apr 14 14:26:55 user nova-compute[71347]:       </nova:ports>
Apr 14 14:26:55 user nova-compute[71347]:     </nova:instance>
Apr 14 14:26:55 user nova-compute[71347]:   </metadata>
Apr 14 14:26:55 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:26:55 user nova-compute[71347]:     <system>
Apr 14 14:26:55 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:26:55 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:26:55 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:26:55 user nova-compute[71347]:       <entry name="serial">5e419ecb-c1e3-4713-a190-62a7f220d01a</entry>
Apr 14 14:26:55 user nova-compute[71347]:       <entry name="uuid">5e419ecb-c1e3-4713-a190-62a7f220d01a</entry>
Apr 14 14:26:55 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:26:55 user nova-compute[71347]:     </system>
Apr 14 14:26:55 user nova-compute[71347]:   </sysinfo>
Apr 14 14:26:55 user nova-compute[71347]:   <os>
Apr 14 14:26:55 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:26:55 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:26:55 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:26:55 user nova-compute[71347]:   </os>
Apr 14 14:26:55 user nova-compute[71347]:   <features>
Apr 14 14:26:55 user nova-compute[71347]:     <acpi/>
Apr 14 14:26:55 user nova-compute[71347]:     <apic/>
Apr 14 14:26:55 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:26:55 user nova-compute[71347]:   </features>
Apr 14 14:26:55 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:26:55 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:26:55 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:26:55 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:26:55 user nova-compute[71347]:   </clock>
Apr 14 14:26:55 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:26:55 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:26:55 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:26:55 user nova-compute[71347]:   </cpu>
Apr 14 14:26:55 user nova-compute[71347]:   <devices>
Apr 14 14:26:55 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:26:55 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:26:55 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk"/>
Apr 14 14:26:55 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:26:55 user nova-compute[71347]:     </disk>
Apr 14 14:26:55 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:26:55 user nova-compute[71347]:       <mac address="fa:16:3e:58:e9:07"/>
Apr 14 14:26:55 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:26:55 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:26:55 user nova-compute[71347]:       <target dev="tap017c2389-45"/>
Apr 14 14:26:55 user nova-compute[71347]:     </interface>
Apr 14 14:26:55 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:26:55 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/console.log" append="off"/>
Apr 14 14:26:55 user nova-compute[71347]:     </serial>
Apr 14 14:26:55 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:26:55 user nova-compute[71347]:     <video>
Apr 14 14:26:55 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:26:55 user nova-compute[71347]:     </video>
Apr 14 14:26:55 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:26:55 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:26:55 user nova-compute[71347]:     </rng>
Apr 14 14:26:55 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:26:55 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:26:55 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:26:55 user nova-compute[71347]:     </memballoon>
Apr 14 14:26:55 user nova-compute[71347]:   </devices>
Apr 14 14:26:55 user nova-compute[71347]: </domain>
Apr 14 14:26:55 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1608636042',display_name='tempest-TestMinimumBasicScenario-server-1608636042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1608636042',id=24,image_ref='9de2d251-ab11-4790-9d8b-f377d8e365bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLPNmyz5FZJ3JAXf567ogWCKZDDVaqr9sdsziyTaoW8c91s8+u4CUBY6blg8NMdt+y5NCYJ1EOsl2swnOrdXNwIidTwhVARRGFOvEPgRirEEdPwZP062lK/mCMIA4xsg==',key_name='tempest-TestMinimumBasicScenario-349171501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-y4b0kty0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9de2d251-ab11-4790-9d8b-f377d8e365bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:26:53Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=5e419ecb-c1e3-4713-a190-62a7f220d01a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e9:07,bridge_name='br-int',has_traffic_filtering=True,id=017c2389-4552-4847-9195-84fe74787c99,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017c2389-45') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG os_vif [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e9:07,bridge_name='br-int',has_traffic_filtering=True,id=017c2389-4552-4847-9195-84fe74787c99,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017c2389-45') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap017c2389-45, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap017c2389-45, col_values=(('external_ids', {'iface-id': '017c2389-4552-4847-9195-84fe74787c99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:e9:07', 'vm-uuid': '5e419ecb-c1e3-4713-a190-62a7f220d01a'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:55 user nova-compute[71347]: INFO os_vif [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e9:07,bridge_name='br-int',has_traffic_filtering=True,id=017c2389-4552-4847-9195-84fe74787c99,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017c2389-45')
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No VIF found with MAC fa:16:3e:58:e9:07, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:55 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Took 1.11 seconds to deallocate network for instance.
Apr 14 14:26:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updated VIF entry in instance network info cache for port 017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating instance_info_cache with network_info: [{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d5172a63-813e-4544-b6ef-4d0ae9a43a4e req-5c7e13fc-15d7-499c-8122-2d5a09929ad6 service nova] Releasing lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:26:55 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:56 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Deleted allocations for instance fafce4d3-18c4-4f15-af62-e599c7749efe
Apr 14 14:26:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received event network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Acquiring lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] No waiting events found dispatching network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:56 user nova-compute[71347]: WARNING nova.compute.manager [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received unexpected event network-vif-plugged-b3956c03-e69e-4181-940f-8e9e890b36ad for instance with vm_state deleted and task_state None.
Apr 14 14:26:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-17ab552b-9f6e-4f26-b008-d41b5dd40948 req-be812125-c8b2-41a4-9e60-296eee2e4e5a service nova] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Received event network-vif-deleted-b3956c03-e69e-4181-940f-8e9e890b36ad {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fc1ab004-0239-4927-96a8-e73b39e2c8f1 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "fafce4d3-18c4-4f15-af62-e599c7749efe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.937s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] No waiting events found dispatching network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:57 user nova-compute[71347]: WARNING nova.compute.manager [req-de62855c-40f5-494a-a806-644a6713f0d2 req-29352cb9-35c9-44c8-b9f0-4883ff57566f service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received unexpected event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 for instance with vm_state building and task_state spawning.
Apr 14 14:26:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482402.523777, c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:57 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] VM Stopped (Lifecycle Event)
Apr 14 14:26:57 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c4f304b7-b115-4629-b6b7-86654215004a None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:57 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:26:58 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482418.9692388, 5e419ecb-c1e3-4713-a190-62a7f220d01a => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:58 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] VM Resumed (Lifecycle Event)
Apr 14 14:26:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:26:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:26:58 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Instance spawned successfully.
Apr 14 14:26:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:26:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:26:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482418.9743116, 5e419ecb-c1e3-4713-a190-62a7f220d01a => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:26:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] VM Started (Lifecycle Event)
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:26:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.compute.manager [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.compute.manager [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] No waiting events found dispatching network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:26:59 user nova-compute[71347]: WARNING nova.compute.manager [req-4087d5df-7fd2-4601-b6c0-6a54ec40f63b req-d062fea4-7192-4031-9e95-447f9ffb6448 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received unexpected event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 for instance with vm_state building and task_state spawning.
Apr 14 14:26:59 user nova-compute[71347]: INFO nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Took 5.94 seconds to spawn the instance on the hypervisor.
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:26:59 user nova-compute[71347]: INFO nova.compute.manager [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Took 6.65 seconds to build instance.
Apr 14 14:26:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-400eedff-7f30-497d-b594-075bea909c65 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.790s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:26:59 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:03 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:03 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=26.3988037109375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Applying migration context for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e as it has an incoming, in-progress migration 14233289-b464-48b3-b656-68f2ba128891. Migration status is finished {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 14:27:03 user nova-compute[71347]: INFO nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating resource usage from migration 14233289-b464-48b3-b656-68f2ba128891
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Migration 14233289-b464-48b3-b656-68f2ba128891 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:27:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:04 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:27:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:06 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:09 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482414.3055604, fafce4d3-18c4-4f15-af62-e599c7749efe => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:09 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] VM Stopped (Lifecycle Event)
Apr 14 14:27:09 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e64c7d21-8751-40ca-89de-348f0595279c None None] [instance: fafce4d3-18c4-4f15-af62-e599c7749efe] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8ba61f44-8536-4642-8d41-07ded8c58e1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:27:23 user nova-compute[71347]: INFO nova.compute.claims [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Claim successful on node user
Apr 14 14:27:23 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:27:23 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:27:23 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:27:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:27:24 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Creating image(s)
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "/opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "/opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG nova.policy [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2de5e6883ff54d049fba7810fe4f1f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6ef742f6534538a9452fe0d4ddce56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk 1073741824" returned: 0 in 0.052s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Cannot resize image /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lazy-loading 'migration_context' on Instance uuid 8ba61f44-8536-4642-8d41-07ded8c58e1b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Ensure instance console log exists: /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:25 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Successfully created port: 80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:27:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-changed-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Refreshing instance network info cache due to event network-changed-72e0d4cc-2ecb-438e-97d0-faf165fef862. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:27:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] Acquiring lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] Acquired lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:25 user nova-compute[71347]: DEBUG nova.network.neutron [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Refreshing network info cache for port 72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'flavor' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:26 user nova-compute[71347]: INFO nova.compute.manager [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Attaching volume 6b260ade-e92c-4dc6-8df7-54de936c6877 to /dev/vdb
Apr 14 14:27:26 user nova-compute[71347]: DEBUG os_brick.utils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64b7123-e0b3-4818-9260-0cdfc81c61b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Successfully updated port: 80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc399ac1-4a89-4b9f-a0bd-6d64ef1f282f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "refresh_cache-8ba61f44-8536-4642-8d41-07ded8c58e1b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquired lock "refresh_cache-8ba61f44-8536-4642-8d41-07ded8c58e1b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aad63fb-f30b-49ea-af51-4b4282b97b30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b7ae3b-4cfe-48ad-b10a-549c9d42b218]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updated VIF entry in instance network info cache for port 72e0d4cc-2ecb-438e-97d0-faf165fef862. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating instance_info_cache with network_info: [{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-616d88f8-9b8b-4034-97cf-6f3c446fe999 req-b6bc3fa5-6b8f-4f33-b638-f6629d873a26 service nova] Releasing lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:27:26 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e9ac30-efed-49ad-bc96-a76af3798824]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG os_brick.utils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating existing volume attachment record: 3aa5c96f-090b-4a1b-931e-e004b568053e {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received event network-changed-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Refreshing instance network info cache due to event network-changed-80e312fb-30d9-4faa-9752-dedbe93524f1. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] Acquiring lock "refresh_cache-8ba61f44-8536-4642-8d41-07ded8c58e1b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Updating instance_info_cache with network_info: [{"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Releasing lock "refresh_cache-8ba61f44-8536-4642-8d41-07ded8c58e1b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Instance network_info: |[{"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] Acquired lock "refresh_cache-8ba61f44-8536-4642-8d41-07ded8c58e1b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Refreshing network info cache for port 80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Start _get_guest_xml network_info=[{"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:27:27 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:27 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1293967311',display_name='tempest-VolumesActionsTest-instance-1293967311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1293967311',id=25,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd6ef742f6534538a9452fe0d4ddce56',ramdisk_id='',reservation_id='r-04akxtad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1447608595',owner_user_name='tempest-VolumesActionsTest-1447608595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:27:24Z,user_data=None,user_id='2de5e6883ff54d049fba7810fe4f1f38',uuid=8ba61f44-8536-4642-8d41-07ded8c58e1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converting VIF {"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:98:41,bridge_name='br-int',has_traffic_filtering=True,id=80e312fb-30d9-4faa-9752-dedbe93524f1,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e312fb-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ba61f44-8536-4642-8d41-07ded8c58e1b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:27:27 user nova-compute[71347]:   <uuid>8ba61f44-8536-4642-8d41-07ded8c58e1b</uuid>
Apr 14 14:27:27 user nova-compute[71347]:   <name>instance-00000019</name>
Apr 14 14:27:27 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:27:27 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:27:27 user nova-compute[71347]:   <metadata>
Apr 14 14:27:27 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:27:27 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:27:27 user nova-compute[71347]:       <nova:name>tempest-VolumesActionsTest-instance-1293967311</nova:name>
Apr 14 14:27:27 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:27:27</nova:creationTime>
Apr 14 14:27:27 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:27:27 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:27:27 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:27:27 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:27:27 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:27:27 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:27:27 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:27:27 user nova-compute[71347]:       <nova:owner>
Apr 14 14:27:27 user nova-compute[71347]:         <nova:user uuid="2de5e6883ff54d049fba7810fe4f1f38">tempest-VolumesActionsTest-1447608595-project-member</nova:user>
Apr 14 14:27:27 user nova-compute[71347]:         <nova:project uuid="cd6ef742f6534538a9452fe0d4ddce56">tempest-VolumesActionsTest-1447608595</nova:project>
Apr 14 14:27:27 user nova-compute[71347]:       </nova:owner>
Apr 14 14:27:27 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:27:27 user nova-compute[71347]:       <nova:ports>
Apr 14 14:27:27 user nova-compute[71347]:         <nova:port uuid="80e312fb-30d9-4faa-9752-dedbe93524f1">
Apr 14 14:27:27 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 14:27:27 user nova-compute[71347]:         </nova:port>
Apr 14 14:27:27 user nova-compute[71347]:       </nova:ports>
Apr 14 14:27:27 user nova-compute[71347]:     </nova:instance>
Apr 14 14:27:27 user nova-compute[71347]:   </metadata>
Apr 14 14:27:27 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:27:27 user nova-compute[71347]:     <system>
Apr 14 14:27:27 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:27:27 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:27:27 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:27:27 user nova-compute[71347]:       <entry name="serial">8ba61f44-8536-4642-8d41-07ded8c58e1b</entry>
Apr 14 14:27:27 user nova-compute[71347]:       <entry name="uuid">8ba61f44-8536-4642-8d41-07ded8c58e1b</entry>
Apr 14 14:27:27 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:27:27 user nova-compute[71347]:     </system>
Apr 14 14:27:27 user nova-compute[71347]:   </sysinfo>
Apr 14 14:27:27 user nova-compute[71347]:   <os>
Apr 14 14:27:27 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:27:27 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:27:27 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:27:27 user nova-compute[71347]:   </os>
Apr 14 14:27:27 user nova-compute[71347]:   <features>
Apr 14 14:27:27 user nova-compute[71347]:     <acpi/>
Apr 14 14:27:27 user nova-compute[71347]:     <apic/>
Apr 14 14:27:27 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:27:27 user nova-compute[71347]:   </features>
Apr 14 14:27:27 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:27:27 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:27:27 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:27:27 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:27:27 user nova-compute[71347]:   </clock>
Apr 14 14:27:27 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:27:27 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:27:27 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:27:27 user nova-compute[71347]:   </cpu>
Apr 14 14:27:27 user nova-compute[71347]:   <devices>
Apr 14 14:27:27 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:27:27 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:27:27 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk"/>
Apr 14 14:27:27 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:27:27 user nova-compute[71347]:     </disk>
Apr 14 14:27:27 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:27:27 user nova-compute[71347]:       <mac address="fa:16:3e:34:98:41"/>
Apr 14 14:27:27 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:27:27 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:27:27 user nova-compute[71347]:       <target dev="tap80e312fb-30"/>
Apr 14 14:27:27 user nova-compute[71347]:     </interface>
Apr 14 14:27:27 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:27:27 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/console.log" append="off"/>
Apr 14 14:27:27 user nova-compute[71347]:     </serial>
Apr 14 14:27:27 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:27:27 user nova-compute[71347]:     <video>
Apr 14 14:27:27 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:27:27 user nova-compute[71347]:     </video>
Apr 14 14:27:27 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:27:27 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:27:27 user nova-compute[71347]:     </rng>
Apr 14 14:27:27 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:27:27 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:27:27 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:27:27 user nova-compute[71347]:     </memballoon>
Apr 14 14:27:27 user nova-compute[71347]:   </devices>
Apr 14 14:27:27 user nova-compute[71347]: </domain>
Apr 14 14:27:27 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1293967311',display_name='tempest-VolumesActionsTest-instance-1293967311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1293967311',id=25,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd6ef742f6534538a9452fe0d4ddce56',ramdisk_id='',reservation_id='r-04akxtad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1447608595',owner_user_name='tempest-VolumesActionsTest-1447608595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:27:24Z,user_data=None,user_id='2de5e6883ff54d049fba7810fe4f1f38',uuid=8ba61f44-8536-4642-8d41-07ded8c58e1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converting VIF {"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:98:41,bridge_name='br-int',has_traffic_filtering=True,id=80e312fb-30d9-4faa-9752-dedbe93524f1,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e312fb-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG os_vif [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:98:41,bridge_name='br-int',has_traffic_filtering=True,id=80e312fb-30d9-4faa-9752-dedbe93524f1,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e312fb-30') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80e312fb-30, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80e312fb-30, col_values=(('external_ids', {'iface-id': '80e312fb-30d9-4faa-9752-dedbe93524f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:98:41', 'vm-uuid': '8ba61f44-8536-4642-8d41-07ded8c58e1b'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:27 user nova-compute[71347]: INFO os_vif [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:98:41,bridge_name='br-int',has_traffic_filtering=True,id=80e312fb-30d9-4faa-9752-dedbe93524f1,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e312fb-30')
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:27:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] No VIF found with MAC fa:16:3e:34:98:41, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Updated VIF entry in instance network info cache for port 80e312fb-30d9-4faa-9752-dedbe93524f1. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Updating instance_info_cache with network_info: [{"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2c3afa4f-acbe-4cd5-813e-8a8c100b7767 req-6e80763a-cfe3-499d-8005-3e67411c8ce8 service nova] Releasing lock "refresh_cache-8ba61f44-8536-4642-8d41-07ded8c58e1b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received event network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] Acquiring lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] No waiting events found dispatching network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:28 user nova-compute[71347]: WARNING nova.compute.manager [req-97242a6e-5fc0-435a-999c-aeac172345c4 req-40a21d6d-ada2-45a7-8645-84dcd7dc10be service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received unexpected event network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 for instance with vm_state building and task_state spawning.
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482450.7353835, 8ba61f44-8536-4642-8d41-07ded8c58e1b => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:30 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] VM Resumed (Lifecycle Event)
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:27:30 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Instance spawned successfully.
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:30 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482450.736667, 8ba61f44-8536-4642-8d41-07ded8c58e1b => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:30 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] VM Started (Lifecycle Event)
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received event network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] Acquiring lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] No waiting events found dispatching network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:30 user nova-compute[71347]: WARNING nova.compute.manager [req-4571ef0c-f37d-43e6-96a1-b05023717ee4 req-b73b42e9-58ab-47d7-abad-cafa8079d7e7 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received unexpected event network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 for instance with vm_state building and task_state spawning.
Apr 14 14:27:30 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:27:30 user nova-compute[71347]: INFO nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Took 6.77 seconds to spawn the instance on the hypervisor.
Apr 14 14:27:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:30 user nova-compute[71347]: INFO nova.compute.manager [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Took 7.48 seconds to build instance.
Apr 14 14:27:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c75f06fc-c409-4b01-b334-cedf83d63f8d tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.586s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgtIruVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:27:31 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:27:31 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:27:31 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a5b7c2-5ffb-4861-b079-79319cc36ca7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:27:31 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87be781-9ba4-475f-bda6-6aeda036cbe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877] added
Apr 14 14:27:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ec128f-ac19-4f7f-a88f-e3400844644a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e30e26-0878-4e1b-80d9-ce8a9eeb8ebd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgtIruVC {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgtIruVC" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5f414d-0e1f-49fb-91a3-0a2be910a5be]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgtIruVC'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b33909-37ca-412e-893c-b2da5d1040db]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5932d6eb-826c-475b-8d22-663c91354a27]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[227d1819-86de-4840-939b-281880c450e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877, portal: 172.16.0.220,3260]
Apr 14 14:27:31 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877, portal: 172.16.0.220,3260] successful.
Apr 14 14:27:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6957a06-a432-4a2f-aedd-0d28012941ea]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b52be46-4c2c-4a8c-855e-603196dd8659]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:27:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c46cf02-8de9-4aa4-a17c-8e2bcdf4dcad]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:27:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:32 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:27:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgtIruVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:27:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:27:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23531363465343437', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:27:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531363465343437', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:27:32 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'flavor' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:27:32 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:27:32 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:27:32 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:27:32 user nova-compute[71347]:   <serial>6b260ade-e92c-4dc6-8df7-54de936c6877</serial>
Apr 14 14:27:32 user nova-compute[71347]: </disk>
Apr 14 14:27:32 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:27:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:27:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:27:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No VIF found with MAC fa:16:3e:2b:9a:e1, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:27:33 user nova-compute[71347]: INFO nova.compute.manager [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Unrescuing
Apr 14 14:27:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquired lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:33 user nova-compute[71347]: DEBUG nova.network.neutron [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:27:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5903e86-179a-485a-9134-6321b614e926 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.196s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:34 user nova-compute[71347]: INFO nova.compute.manager [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Rescuing
Apr 14 14:27:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquired lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG nova.network.neutron [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Releasing lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG nova.objects.instance [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'flavor' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:35 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance destroyed successfully.
Apr 14 14:27:35 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating instance_info_cache with network_info: [{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Releasing lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:35 user nova-compute[71347]: DEBUG nova.compute.manager [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:35 user nova-compute[71347]: DEBUG nova.compute.manager [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:35 user nova-compute[71347]: WARNING nova.compute.manager [req-2d811ed9-4093-4b13-9731-4f8f4fb4db93 req-8d27745b-1df9-4d13-8a36-961f1edb7184 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:27:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:37 user nova-compute[71347]: WARNING nova.compute.manager [req-52e6778d-f652-4eb2-aad7-8914fff9b828 req-a0462c2e-2126-4b95-ac11-c8570d028530 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state active and task_state rescuing.
Apr 14 14:27:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance destroyed successfully.
Apr 14 14:27:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Attempting rescue
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71347) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance directory exists: not creating {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 14:27:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Creating image(s)
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'trusted_certs' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.168s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue" returned: 0 in 0.064s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'migration_context' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Start _get_guest_xml network_info=[{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:2b:9a:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'resources' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'numa_topology' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:37 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:37 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'vcpu_model' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056227109',display_name='tempest-ServerRescueNegativeTestJSON-server-2056227109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056227109',id=23,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPuRsvBsGHusqtnaC8Oj9LBXgh3nY9LkQ3OL84XGLcTKFxNlys1/HBw5E8x0pZTchYk3yzjHgyDVXSLOySeUV4vk6BzjfyRxiyugq/K16fvubSEZS4xq2p9ZGyf7T/74w==',key_name='tempest-keypair-1178292711',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:25:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-d3hey8gz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:25:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:2b:9a:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "vif_mac": "fa:16:3e:2b:9a:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9a:e1,bridge_name='br-int',has_traffic_filtering=True,id=72e0d4cc-2ecb-438e-97d0-faf165fef862,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e0d4cc-2e') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'pci_devices' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:27:38 user nova-compute[71347]:   <uuid>fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b</uuid>
Apr 14 14:27:38 user nova-compute[71347]:   <name>instance-00000017</name>
Apr 14 14:27:38 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:27:38 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:27:38 user nova-compute[71347]:   <metadata>
Apr 14 14:27:38 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:27:38 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:27:38 user nova-compute[71347]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2056227109</nova:name>
Apr 14 14:27:38 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:27:37</nova:creationTime>
Apr 14 14:27:38 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:27:38 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:27:38 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:27:38 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:27:38 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:27:38 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:27:38 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:27:38 user nova-compute[71347]:       <nova:owner>
Apr 14 14:27:38 user nova-compute[71347]:         <nova:user uuid="cdfcb787b0f545f8b19e947d54d07b9c">tempest-ServerRescueNegativeTestJSON-1435712120-project-member</nova:user>
Apr 14 14:27:38 user nova-compute[71347]:         <nova:project uuid="b53efd997e3e47d898264dae8a27a5ad">tempest-ServerRescueNegativeTestJSON-1435712120</nova:project>
Apr 14 14:27:38 user nova-compute[71347]:       </nova:owner>
Apr 14 14:27:38 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:27:38 user nova-compute[71347]:       <nova:ports>
Apr 14 14:27:38 user nova-compute[71347]:         <nova:port uuid="72e0d4cc-2ecb-438e-97d0-faf165fef862">
Apr 14 14:27:38 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 14:27:38 user nova-compute[71347]:         </nova:port>
Apr 14 14:27:38 user nova-compute[71347]:       </nova:ports>
Apr 14 14:27:38 user nova-compute[71347]:     </nova:instance>
Apr 14 14:27:38 user nova-compute[71347]:   </metadata>
Apr 14 14:27:38 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:27:38 user nova-compute[71347]:     <system>
Apr 14 14:27:38 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:27:38 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:27:38 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:27:38 user nova-compute[71347]:       <entry name="serial">fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b</entry>
Apr 14 14:27:38 user nova-compute[71347]:       <entry name="uuid">fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b</entry>
Apr 14 14:27:38 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:27:38 user nova-compute[71347]:     </system>
Apr 14 14:27:38 user nova-compute[71347]:   </sysinfo>
Apr 14 14:27:38 user nova-compute[71347]:   <os>
Apr 14 14:27:38 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:27:38 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:27:38 user nova-compute[71347]:   </os>
Apr 14 14:27:38 user nova-compute[71347]:   <features>
Apr 14 14:27:38 user nova-compute[71347]:     <acpi/>
Apr 14 14:27:38 user nova-compute[71347]:     <apic/>
Apr 14 14:27:38 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:27:38 user nova-compute[71347]:   </features>
Apr 14 14:27:38 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:27:38 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:27:38 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:27:38 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:27:38 user nova-compute[71347]:   </clock>
Apr 14 14:27:38 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:27:38 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:27:38 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:27:38 user nova-compute[71347]:   </cpu>
Apr 14 14:27:38 user nova-compute[71347]:   <devices>
Apr 14 14:27:38 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:27:38 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:27:38 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue"/>
Apr 14 14:27:38 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:27:38 user nova-compute[71347]:     </disk>
Apr 14 14:27:38 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:27:38 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:27:38 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk"/>
Apr 14 14:27:38 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:27:38 user nova-compute[71347]:     </disk>
Apr 14 14:27:38 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:27:38 user nova-compute[71347]:       <mac address="fa:16:3e:2b:9a:e1"/>
Apr 14 14:27:38 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:27:38 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:27:38 user nova-compute[71347]:       <target dev="tap72e0d4cc-2e"/>
Apr 14 14:27:38 user nova-compute[71347]:     </interface>
Apr 14 14:27:38 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:27:38 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/console.log" append="off"/>
Apr 14 14:27:38 user nova-compute[71347]:     </serial>
Apr 14 14:27:38 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:27:38 user nova-compute[71347]:     <video>
Apr 14 14:27:38 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:27:38 user nova-compute[71347]:     </video>
Apr 14 14:27:38 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:27:38 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:27:38 user nova-compute[71347]:     </rng>
Apr 14 14:27:38 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:27:38 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:27:38 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:27:38 user nova-compute[71347]:     </memballoon>
Apr 14 14:27:38 user nova-compute[71347]:   </devices>
Apr 14 14:27:38 user nova-compute[71347]: </domain>
Apr 14 14:27:38 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-changed-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Refreshing instance network info cache due to event network-changed-fc6a8af0-4a67-4942-9548-41928d3f3f5d. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Acquiring lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Acquired lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Refreshing network info cache for port fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:27:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance destroyed successfully.
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] No VIF found with MAC fa:16:3e:2b:9a:e1, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updated VIF entry in instance network info cache for port fc6a8af0-4a67-4942-9548-41928d3f3f5d. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Releasing lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-changed-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Refreshing instance network info cache due to event network-changed-fc6a8af0-4a67-4942-9548-41928d3f3f5d. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Acquiring lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Acquired lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Refreshing network info cache for port fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:39 user nova-compute[71347]: WARNING nova.compute.manager [req-cce941be-badb-4989-8da5-e9a0374f2788 req-8b922e30-669d-4f3e-932c-79d966eedf87 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state active and task_state rescuing.
Apr 14 14:27:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 18a432a7-c206-4cf8-9718-7d5360d97f4e due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482459.8077698, 18a432a7-c206-4cf8-9718-7d5360d97f4e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:39 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] VM Resumed (Lifecycle Event)
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-593752bb-8f8d-406c-b74a-8e3cb27cc7ec tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:39 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482459.8083382, 18a432a7-c206-4cf8-9718-7d5360d97f4e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:39 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] VM Started (Lifecycle Event)
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:40 user nova-compute[71347]: WARNING nova.compute.manager [req-6698e840-4b09-4610-b070-1190a9a0a82b req-88103827-c48a-4b37-9850-65e51b7c2fc7 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state active and task_state None.
Apr 14 14:27:40 user nova-compute[71347]: DEBUG nova.network.neutron [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updated VIF entry in instance network info cache for port fc6a8af0-4a67-4942-9548-41928d3f3f5d. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG nova.network.neutron [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [{"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Releasing lock "refresh_cache-18a432a7-c206-4cf8-9718-7d5360d97f4e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:40 user nova-compute[71347]: WARNING nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:27:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:40 user nova-compute[71347]: WARNING nova.compute.manager [req-8bd2a3be-ea28-4e96-8482-e759a53f2d3e req-ff4e4b33-b9df-4af1-808a-012ea5bc6b4c service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:27:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:41 user nova-compute[71347]: WARNING nova.compute.manager [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state active and task_state rescuing.
Apr 14 14:27:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:41 user nova-compute[71347]: WARNING nova.compute.manager [req-e7f148a7-6884-41dc-998a-09254c7197e4 req-62a10fc0-5b12-4aa3-8c0f-9a1803e58b7d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state active and task_state rescuing.
Apr 14 14:27:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482461.960466, fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:41 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] VM Resumed (Lifecycle Event)
Apr 14 14:27:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2ca0dfbd-c6d6-4686-987a-c9638a5795c5 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 14:27:42 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482461.9689584, fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] VM Started (Lifecycle Event)
Apr 14 14:27:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:27:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:27:47 user nova-compute[71347]: INFO nova.compute.claims [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Claim successful on node user
Apr 14 14:27:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:27:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.policy [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:27:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Creating image(s)
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "/opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "/opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.157s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk 1073741824" returned: 0 in 0.296s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.463s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.156s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Successfully created port: 4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Cannot resize image /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG nova.objects.instance [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'migration_context' on Instance uuid 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Ensure instance console log exists: /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Successfully updated port: 4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:27:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquired lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:27:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received event network-changed-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Refreshing instance network info cache due to event network-changed-4a9de01b-07a4-4bcf-933f-3d493bae2db1. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:27:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] Acquiring lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Updating instance_info_cache with network_info: [{"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Releasing lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Instance network_info: |[{"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] Acquired lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Refreshing network info cache for port 4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Start _get_guest_xml network_info=[{"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:27:51 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:51 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-43491806',display_name='tempest-AttachVolumeNegativeTest-server-43491806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-43491806',id=26,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH77xmesvyrmE1nAACucYPHAK4jz+KuavjrQv5Px2cfKULQzmGdyTrtF5BDnN0G67IJwSYDCGCPSiqFhrETT+fyIeq+l5kZcow5VXI+HPlKRgVceDjHUIn5ctKoxERtfA==',key_name='tempest-keypair-1827852531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-szl41osq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:27:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=4fa04501-bc13-4309-b3a2-d972e2fc7c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:98:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a9de01b-07a4-4bcf-933f-3d493bae2db1,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a9de01b-07') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.objects.instance [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:27:51 user nova-compute[71347]:   <uuid>4fa04501-bc13-4309-b3a2-d972e2fc7c93</uuid>
Apr 14 14:27:51 user nova-compute[71347]:   <name>instance-0000001a</name>
Apr 14 14:27:51 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:27:51 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:27:51 user nova-compute[71347]:   <metadata>
Apr 14 14:27:51 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:27:51 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:27:51 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeNegativeTest-server-43491806</nova:name>
Apr 14 14:27:51 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:27:51</nova:creationTime>
Apr 14 14:27:51 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:27:51 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:27:51 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:27:51 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:27:51 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:27:51 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:27:51 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:27:51 user nova-compute[71347]:       <nova:owner>
Apr 14 14:27:51 user nova-compute[71347]:         <nova:user uuid="5db83169bedc4520b5e2a2b595362ec1">tempest-AttachVolumeNegativeTest-134968716-project-member</nova:user>
Apr 14 14:27:51 user nova-compute[71347]:         <nova:project uuid="df56fb88b961464496757a358fd15169">tempest-AttachVolumeNegativeTest-134968716</nova:project>
Apr 14 14:27:51 user nova-compute[71347]:       </nova:owner>
Apr 14 14:27:51 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:27:51 user nova-compute[71347]:       <nova:ports>
Apr 14 14:27:51 user nova-compute[71347]:         <nova:port uuid="4a9de01b-07a4-4bcf-933f-3d493bae2db1">
Apr 14 14:27:51 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 14:27:51 user nova-compute[71347]:         </nova:port>
Apr 14 14:27:51 user nova-compute[71347]:       </nova:ports>
Apr 14 14:27:51 user nova-compute[71347]:     </nova:instance>
Apr 14 14:27:51 user nova-compute[71347]:   </metadata>
Apr 14 14:27:51 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:27:51 user nova-compute[71347]:     <system>
Apr 14 14:27:51 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:27:51 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:27:51 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:27:51 user nova-compute[71347]:       <entry name="serial">4fa04501-bc13-4309-b3a2-d972e2fc7c93</entry>
Apr 14 14:27:51 user nova-compute[71347]:       <entry name="uuid">4fa04501-bc13-4309-b3a2-d972e2fc7c93</entry>
Apr 14 14:27:51 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:27:51 user nova-compute[71347]:     </system>
Apr 14 14:27:51 user nova-compute[71347]:   </sysinfo>
Apr 14 14:27:51 user nova-compute[71347]:   <os>
Apr 14 14:27:51 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:27:51 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:27:51 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:27:51 user nova-compute[71347]:   </os>
Apr 14 14:27:51 user nova-compute[71347]:   <features>
Apr 14 14:27:51 user nova-compute[71347]:     <acpi/>
Apr 14 14:27:51 user nova-compute[71347]:     <apic/>
Apr 14 14:27:51 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:27:51 user nova-compute[71347]:   </features>
Apr 14 14:27:51 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:27:51 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:27:51 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:27:51 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:27:51 user nova-compute[71347]:   </clock>
Apr 14 14:27:51 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:27:51 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:27:51 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:27:51 user nova-compute[71347]:   </cpu>
Apr 14 14:27:51 user nova-compute[71347]:   <devices>
Apr 14 14:27:51 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:27:51 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:27:51 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk"/>
Apr 14 14:27:51 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:27:51 user nova-compute[71347]:     </disk>
Apr 14 14:27:51 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:27:51 user nova-compute[71347]:       <mac address="fa:16:3e:c8:98:7d"/>
Apr 14 14:27:51 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:27:51 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:27:51 user nova-compute[71347]:       <target dev="tap4a9de01b-07"/>
Apr 14 14:27:51 user nova-compute[71347]:     </interface>
Apr 14 14:27:51 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:27:51 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/console.log" append="off"/>
Apr 14 14:27:51 user nova-compute[71347]:     </serial>
Apr 14 14:27:51 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:27:51 user nova-compute[71347]:     <video>
Apr 14 14:27:51 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:27:51 user nova-compute[71347]:     </video>
Apr 14 14:27:51 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:27:51 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:27:51 user nova-compute[71347]:     </rng>
Apr 14 14:27:51 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:27:51 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:27:51 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:27:51 user nova-compute[71347]:     </memballoon>
Apr 14 14:27:51 user nova-compute[71347]:   </devices>
Apr 14 14:27:51 user nova-compute[71347]: </domain>
Apr 14 14:27:51 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-43491806',display_name='tempest-AttachVolumeNegativeTest-server-43491806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-43491806',id=26,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH77xmesvyrmE1nAACucYPHAK4jz+KuavjrQv5Px2cfKULQzmGdyTrtF5BDnN0G67IJwSYDCGCPSiqFhrETT+fyIeq+l5kZcow5VXI+HPlKRgVceDjHUIn5ctKoxERtfA==',key_name='tempest-keypair-1827852531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-szl41osq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:27:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=4fa04501-bc13-4309-b3a2-d972e2fc7c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:98:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a9de01b-07a4-4bcf-933f-3d493bae2db1,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a9de01b-07') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG os_vif [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:98:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a9de01b-07a4-4bcf-933f-3d493bae2db1,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a9de01b-07') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a9de01b-07, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a9de01b-07, col_values=(('external_ids', {'iface-id': '4a9de01b-07a4-4bcf-933f-3d493bae2db1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:98:7d', 'vm-uuid': '4fa04501-bc13-4309-b3a2-d972e2fc7c93'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:51 user nova-compute[71347]: INFO os_vif [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:98:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a9de01b-07a4-4bcf-933f-3d493bae2db1,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a9de01b-07')
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No VIF found with MAC fa:16:3e:c8:98:7d, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Updated VIF entry in instance network info cache for port 4a9de01b-07a4-4bcf-933f-3d493bae2db1. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Updating instance_info_cache with network_info: [{"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bb501633-4b05-4983-9a4f-215c0fecc7f2 req-a4aabe63-ff3e-441e-89cd-8fc9be9dfaba service nova] Releasing lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:27:51 user nova-compute[71347]: INFO nova.compute.claims [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Claim successful on node user
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:27:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.policy [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:27:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Creating image(s)
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "/opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "/opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:52 user nova-compute[71347]: INFO nova.compute.manager [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Detaching volume 7c4e8847-0aac-4a87-8a83-09a33dabcca1
Apr 14 14:27:52 user nova-compute[71347]: INFO nova.virt.block_device [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Attempting to driver detach volume 7c4e8847-0aac-4a87-8a83-09a33dabcca1 from mountpoint /dev/vdb
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Attempting to detach device vdb from instance a3faeeb1-a50c-474b-b694-98c4d70435d5 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:27:52 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:27:52 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:27:52 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:27:52 user nova-compute[71347]:   <serial>7c4e8847-0aac-4a87-8a83-09a33dabcca1</serial>
Apr 14 14:27:52 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 14:27:52 user nova-compute[71347]: </disk>
Apr 14 14:27:52 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully detached device vdb from instance a3faeeb1-a50c-474b-b694-98c4d70435d5 from the persistent domain config.
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3faeeb1-a50c-474b-b694-98c4d70435d5 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:27:52 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:27:52 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:27:52 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:27:52 user nova-compute[71347]:   <serial>7c4e8847-0aac-4a87-8a83-09a33dabcca1</serial>
Apr 14 14:27:52 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 14:27:52 user nova-compute[71347]: </disk>
Apr 14 14:27:52 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk 1073741824" returned: 0 in 0.067s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Cannot resize image /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.objects.instance [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'migration_context' on Instance uuid fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Ensure instance console log exists: /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482473.175688, a3faeeb1-a50c-474b-b694-98c4d70435d5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:27:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully detached device vdb from instance a3faeeb1-a50c-474b-b694-98c4d70435d5 from the live domain config.
Apr 14 14:27:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NFmzIspV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:27:53 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received event network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] No waiting events found dispatching network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:53 user nova-compute[71347]: WARNING nova.compute.manager [req-1c4c83df-62ea-4d93-b40e-761714a0891b req-a5b26543-65e1-447a-a3c3-289e67276823 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received unexpected event network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance with vm_state building and task_state spawning.
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[96edc8d6-aa60-4765-aed5-56889aa0add6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:27:53 user nova-compute[71347]: No targets found.
Apr 14 14:27:53 user nova-compute[71347]: iSNS:
Apr 14 14:27:53 user nova-compute[71347]: No targets found.
Apr 14 14:27:53 user nova-compute[71347]: STATIC:
Apr 14 14:27:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da
Apr 14 14:27:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:27:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:27:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:27:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:27:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:27:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:27:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:27:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:27:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1
Apr 14 14:27:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:27:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:27:53 user nova-compute[71347]: FIRMWARE:
Apr 14 14:27:53 user nova-compute[71347]: No targets found.
Apr 14 14:27:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:27:53 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:27:53 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7008591-3fc2-4feb-8e32-1352f52d04c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d89e1-9401-4d5b-b190-5157368dc04c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:27:53 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:27:53 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:27:53 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:27:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:27:53 user nova-compute[71347]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 (non-flash)
Apr 14 14:27:53 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:27:53 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:27:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4c16320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3324218a-1e3e-4c12-b1b1-8b4532e4bf23]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b770e3b-c14c-4873-b4a7-6b4193627f03]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[984503b9-1b53-4359-bb6f-921ffdc47ab9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG nova.network.neutron [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Successfully created port: b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6561d2-4529-49cc-8f0a-18f7229e0968]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d064f-4866-46c3-b6e3-36197992d4de]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391aea8-e9eb-4167-8ba8-7ee8ef2a722b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260]
Apr 14 14:27:53 user nova-compute[71347]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1, portal: 172.16.0.220,3260] successful.
Apr 14 14:27:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c4e8847-0aac-4a87-8a83-09a33dabcca1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfac666-e5ab-459c-b89a-a4e06a622a3e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== disconnect_volume: return (388ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:27:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Successfully updated port: b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquired lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6b912390-abd6-4570-92c9-2e90b1714b56 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.316s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updating instance_info_cache with network_info: [{"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Releasing lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Instance network_info: |[{"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Start _get_guest_xml network_info=[{"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:27:54 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:54 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1757826084',display_name='tempest-TestStampPattern-server-1757826084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1757826084',id=27,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVd5d8f1BuBRppDw9HXKQyu3/1iOI3YZuUkyUZmTb2VBMBhBMIyRKqpoaUA5/dZnFrRfFPyALC45bswJQWvC/+I/l7V8YK8+DU0/n020XSkmcHMDH6Po4guzWitPY9ppA==',key_name='tempest-TestStampPattern-594781561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e043301622414bb492b48f0c6366a2',ramdisk_id='',reservation_id='r-boaldqd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-523457803',owner_user_name='tempest-TestStampPattern-523457803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:27:52Z,user_data=None,user_id='b5bccb6643e84c53ab7f1301bdf0cb97',uuid=fc7da5e7-7b87-458f-82b1-055664003a85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converting VIF {"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:8c:44,bridge_name='br-int',has_traffic_filtering=True,id=b7a7cf30-86d8-48d3-a117-887a3bdc342b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a7cf30-86') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'pci_devices' on Instance uuid fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Port 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef binding to destination host user is already ACTIVE {{(pid=71347) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:27:54 user nova-compute[71347]:   <uuid>fc7da5e7-7b87-458f-82b1-055664003a85</uuid>
Apr 14 14:27:54 user nova-compute[71347]:   <name>instance-0000001b</name>
Apr 14 14:27:54 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:27:54 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:27:54 user nova-compute[71347]:   <metadata>
Apr 14 14:27:54 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:27:54 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:27:54 user nova-compute[71347]:       <nova:name>tempest-TestStampPattern-server-1757826084</nova:name>
Apr 14 14:27:54 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:27:54</nova:creationTime>
Apr 14 14:27:54 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:27:54 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:27:54 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:27:54 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:27:54 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:27:54 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:27:54 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:27:54 user nova-compute[71347]:       <nova:owner>
Apr 14 14:27:54 user nova-compute[71347]:         <nova:user uuid="b5bccb6643e84c53ab7f1301bdf0cb97">tempest-TestStampPattern-523457803-project-member</nova:user>
Apr 14 14:27:54 user nova-compute[71347]:         <nova:project uuid="51e043301622414bb492b48f0c6366a2">tempest-TestStampPattern-523457803</nova:project>
Apr 14 14:27:54 user nova-compute[71347]:       </nova:owner>
Apr 14 14:27:54 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:27:54 user nova-compute[71347]:       <nova:ports>
Apr 14 14:27:54 user nova-compute[71347]:         <nova:port uuid="b7a7cf30-86d8-48d3-a117-887a3bdc342b">
Apr 14 14:27:54 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 14:27:54 user nova-compute[71347]:         </nova:port>
Apr 14 14:27:54 user nova-compute[71347]:       </nova:ports>
Apr 14 14:27:54 user nova-compute[71347]:     </nova:instance>
Apr 14 14:27:54 user nova-compute[71347]:   </metadata>
Apr 14 14:27:54 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:27:54 user nova-compute[71347]:     <system>
Apr 14 14:27:54 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:27:54 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:27:54 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:27:54 user nova-compute[71347]:       <entry name="serial">fc7da5e7-7b87-458f-82b1-055664003a85</entry>
Apr 14 14:27:54 user nova-compute[71347]:       <entry name="uuid">fc7da5e7-7b87-458f-82b1-055664003a85</entry>
Apr 14 14:27:54 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:27:54 user nova-compute[71347]:     </system>
Apr 14 14:27:54 user nova-compute[71347]:   </sysinfo>
Apr 14 14:27:54 user nova-compute[71347]:   <os>
Apr 14 14:27:54 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:27:54 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:27:54 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:27:54 user nova-compute[71347]:   </os>
Apr 14 14:27:54 user nova-compute[71347]:   <features>
Apr 14 14:27:54 user nova-compute[71347]:     <acpi/>
Apr 14 14:27:54 user nova-compute[71347]:     <apic/>
Apr 14 14:27:54 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:27:54 user nova-compute[71347]:   </features>
Apr 14 14:27:54 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:27:54 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:27:54 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:27:54 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:27:54 user nova-compute[71347]:   </clock>
Apr 14 14:27:54 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:27:54 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:27:54 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:27:54 user nova-compute[71347]:   </cpu>
Apr 14 14:27:54 user nova-compute[71347]:   <devices>
Apr 14 14:27:54 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:27:54 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:27:54 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk"/>
Apr 14 14:27:54 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:27:54 user nova-compute[71347]:     </disk>
Apr 14 14:27:54 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:27:54 user nova-compute[71347]:       <mac address="fa:16:3e:c4:8c:44"/>
Apr 14 14:27:54 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:27:54 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:27:54 user nova-compute[71347]:       <target dev="tapb7a7cf30-86"/>
Apr 14 14:27:54 user nova-compute[71347]:     </interface>
Apr 14 14:27:54 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:27:54 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/console.log" append="off"/>
Apr 14 14:27:54 user nova-compute[71347]:     </serial>
Apr 14 14:27:54 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:27:54 user nova-compute[71347]:     <video>
Apr 14 14:27:54 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:27:54 user nova-compute[71347]:     </video>
Apr 14 14:27:54 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:27:54 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:27:54 user nova-compute[71347]:     </rng>
Apr 14 14:27:54 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:27:54 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:27:54 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:27:54 user nova-compute[71347]:     </memballoon>
Apr 14 14:27:54 user nova-compute[71347]:   </devices>
Apr 14 14:27:54 user nova-compute[71347]: </domain>
Apr 14 14:27:54 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1757826084',display_name='tempest-TestStampPattern-server-1757826084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1757826084',id=27,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVd5d8f1BuBRppDw9HXKQyu3/1iOI3YZuUkyUZmTb2VBMBhBMIyRKqpoaUA5/dZnFrRfFPyALC45bswJQWvC/+I/l7V8YK8+DU0/n020XSkmcHMDH6Po4guzWitPY9ppA==',key_name='tempest-TestStampPattern-594781561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e043301622414bb492b48f0c6366a2',ramdisk_id='',reservation_id='r-boaldqd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-523457803',owner_user_name='tempest-TestStampPattern-523457803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:27:52Z,user_data=None,user_id='b5bccb6643e84c53ab7f1301bdf0cb97',uuid=fc7da5e7-7b87-458f-82b1-055664003a85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converting VIF {"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:8c:44,bridge_name='br-int',has_traffic_filtering=True,id=b7a7cf30-86d8-48d3-a117-887a3bdc342b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a7cf30-86') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG os_vif [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:8c:44,bridge_name='br-int',has_traffic_filtering=True,id=b7a7cf30-86d8-48d3-a117-887a3bdc342b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a7cf30-86') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7a7cf30-86, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7a7cf30-86, col_values=(('external_ids', {'iface-id': 'b7a7cf30-86d8-48d3-a117-887a3bdc342b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:8c:44', 'vm-uuid': 'fc7da5e7-7b87-458f-82b1-055664003a85'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:54 user nova-compute[71347]: INFO os_vif [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:8c:44,bridge_name='br-int',has_traffic_filtering=True,id=b7a7cf30-86d8-48d3-a117-887a3bdc342b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a7cf30-86')
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:27:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No VIF found with MAC fa:16:3e:c4:8c:44, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482475.131467, 4fa04501-bc13-4309-b3a2-d972e2fc7c93 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] VM Resumed (Lifecycle Event)
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:27:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Instance spawned successfully.
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482475.1316214, 4fa04501-bc13-4309-b3a2-d972e2fc7c93 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] VM Started (Lifecycle Event)
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:27:55 user nova-compute[71347]: INFO nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Took 6.76 seconds to spawn the instance on the hypervisor.
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received event network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] No waiting events found dispatching network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:55 user nova-compute[71347]: WARNING nova.compute.manager [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received unexpected event network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance with vm_state building and task_state spawning.
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-changed-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Refreshing instance network info cache due to event network-changed-b7a7cf30-86d8-48d3-a117-887a3bdc342b. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Acquiring lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Acquired lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Refreshing network info cache for port b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:55 user nova-compute[71347]: INFO nova.compute.manager [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Took 7.56 seconds to build instance.
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Creating tmpfile /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/tmpk3plklmb to verify with other compute node that the instance is on the same shared storage. {{(pid=71347) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7631b949-4f16-49bc-b931-bb9072a8ee8e tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.665s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71347) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:55 user nova-compute[71347]: WARNING nova.compute.manager [req-5b31b631-ddba-4f6e-aa2a-693ee63cd06c req-23497f9c-5f8f-4be1-bebb-8da37019a8c2 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state resized and task_state resize_reverting.
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updated VIF entry in instance network info cache for port b7a7cf30-86d8-48d3-a117-887a3bdc342b. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updating instance_info_cache with network_info: [{"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:27:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d2e7f39-1850-4a61-9b2f-249e7f71d689 req-a66c3874-a488-4ef5-9ca8-362630eb1446 service nova] Releasing lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance destroyed successfully.
Apr 14 14:27:56 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'resources' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_vif [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:27:56 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance destroyed successfully.
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eb1d71a-d0, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: INFO os_vif [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0')
Apr 14 14:27:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:27:56 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[260243d4-f1f3-4106-8478-3cedd84f2f2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:27:56 user nova-compute[71347]: No targets found.
Apr 14 14:27:56 user nova-compute[71347]: iSNS:
Apr 14 14:27:56 user nova-compute[71347]: No targets found.
Apr 14 14:27:56 user nova-compute[71347]: STATIC:
Apr 14 14:27:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da
Apr 14 14:27:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:27:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:27:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:27:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:27:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:27:56 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:27:56 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:27:56 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:27:56 user nova-compute[71347]: FIRMWARE:
Apr 14 14:27:56 user nova-compute[71347]: No targets found.
Apr 14 14:27:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:27:56 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:27:56 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e008047d-1e48-470b-93b0-bfafbea3e08b tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.092s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c106718-f97a-43f7-bada-050c89586147]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2473fd8-8883-41da-bc0c-b4f00c611c97]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:27:56 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:27:56 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:27:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:27:56 user nova-compute[71347]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:27:56 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:27:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4ce6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a7c1c7-4cc5-4b9d-a1f4-665033deac61]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c3ad38-7a3a-4630-a34d-1c416e2b9360]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a05a3-5bf3-4ddb-a6bc-1506eff1fbbb]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[18018ff1-7340-45b3-8a9d-335efb0e348e]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[192ba945-85d8-40b7-9294-04749d6260e3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[065af887-bba2-4558-8dc9-8ed80c38b12e]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]
Apr 14 14:27:57 user nova-compute[71347]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.
Apr 14 14:27:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[982c54f2-3a61-44cd-9cc4-a9bbbb16feb1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== disconnect_volume: return (378ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] No waiting events found dispatching network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:57 user nova-compute[71347]: WARNING nova.compute.manager [req-30713aef-1e48-4ebe-b27e-3e0ffddb7a0b req-8949aa56-2733-49b4-a804-dd3ec1a5bc49 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received unexpected event network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance with vm_state building and task_state spawning.
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:57 user nova-compute[71347]: WARNING nova.compute.manager [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state stopped and task_state None.
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:57 user nova-compute[71347]: WARNING nova.compute.manager [req-356642a8-7433-451e-83a8-57d9d2a4852d req-2c171f64-ddb6-442d-afea-fb3594bec38d service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state stopped and task_state None.
Apr 14 14:27:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:57 user nova-compute[71347]: WARNING nova.compute.manager [req-e8d7d230-f5fd-4f6e-b310-ac7afbd5fa7c req-3842a975-5ab8-40b1-9498-184670b9348c service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state resized and task_state resize_reverting.
Apr 14 14:27:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'migration_context' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.439s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:58 user nova-compute[71347]: INFO nova.compute.manager [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Swapping old allocation on dict_keys(['a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c']) held by migration 14233289-b464-48b3-b656-68f2ba128891 for instance
Apr 14 14:27:58 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Overwriting current allocation {'allocations': {'a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 32}}, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'consumer_generation': 1} on consumer a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:27:58 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482479.1980727, fc7da5e7-7b87-458f-82b1-055664003a85 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] VM Resumed (Lifecycle Event)
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:27:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Instance spawned successfully.
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482479.2011747, fc7da5e7-7b87-458f-82b1-055664003a85 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:27:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] VM Started (Lifecycle Event)
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:27:59 user nova-compute[71347]: INFO nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Took 7.08 seconds to spawn the instance on the hypervisor.
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:27:59 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.compute.manager [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.compute.manager [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] No waiting events found dispatching network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:27:59 user nova-compute[71347]: WARNING nova.compute.manager [req-f96d13b4-71ab-4174-8cd4-560e297f5768 req-bc61a975-dd45-4cc5-a0bd-971946124dff service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received unexpected event network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance with vm_state building and task_state spawning.
Apr 14 14:27:59 user nova-compute[71347]: INFO nova.compute.manager [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Took 8.17 seconds to build instance.
Apr 14 14:27:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-557434f4-df7c-4d19-b54b-3e22863ee779 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.266s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:27:59 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG os_brick.utils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2539437-5199-4a06-9e0a-9a5c463ab1be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f18cc2-5e36-4faa-88f4-dfa51ba8067e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4095061c-1cd4-48ce-ac1c-aaba11cda209]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d4818f-7728-4a58-89a1-19147cbd9c72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:28:00 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb0c6b9-bade-4fd0-ab3e-c62a2256ed19]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG os_brick.utils [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:28:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:01 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:28:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Starting finish_revert_migration {{(pid=71347) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Start _get_guest_xml network_info=[{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e', 'attached_at': '2023-04-14T14:28:05.000000', 'detached_at': '', 'volume_id': '4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'serial': '4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12'}, 'attachment_id': '933d0c7f-74f4-472e-a005-fb68012f340f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:28:05 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:28:05 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:28:05 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:28:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:28:05 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:28:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:28:05 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8917804-b881-4d23-befa-be292c02c66d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:28:05 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade79d05-5cbf-47cd-8b35-50003e4593b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12] added
Apr 14 14:28:05 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:05 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:28:05 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:28:05 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=26.325363159179688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[345e560c-40d4-4670-96b9-690377bed15c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.116s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d719b679-8db5-4e77-84e3-47ed2557948f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQsUPvbJ {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQsUPvbJ" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bb4dde-7098-4bdf-a438-253f0cb8b961]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQsUPvbJ'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94acd67-c090-414a-9f8c-50655dde6480]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3645770f-a55c-4a16-b978-133e2d89dd0f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:28:06 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:28:06 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c152b83d-7d41-436f-8461-625fe5048c14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]
Apr 14 14:28:06 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.
Apr 14 14:28:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b5e67-bcf2-443b-8883-a810daf5db87]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 8ba61f44-8536-4642-8d41-07ded8c58e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fc7da5e7-7b87-458f-82b1-055664003a85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab04a77-c672-448c-97fc-c209fab45e45]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:28:06 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:06 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:28:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:28:06 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:06 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:28:06 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.958s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[482849b0-57d6-454d-9a7a-293ab96bfd3b]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.966s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.988s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== connect_volume: return (1990ms) {'type': 'block', 'scsi_wwn': '23539326664386133', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539326664386133', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:28:07 user nova-compute[71347]:   <uuid>a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</uuid>
Apr 14 14:28:07 user nova-compute[71347]:   <name>instance-00000005</name>
Apr 14 14:28:07 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:28:07 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:28:07 user nova-compute[71347]:   <metadata>
Apr 14 14:28:07 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:28:07 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:28:07 user nova-compute[71347]:       <nova:name>tempest-ServerActionsTestJSON-server-1012026360</nova:name>
Apr 14 14:28:07 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:28:05</nova:creationTime>
Apr 14 14:28:07 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:28:07 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:28:07 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:28:07 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:28:07 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:28:07 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:28:07 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:28:07 user nova-compute[71347]:       <nova:owner>
Apr 14 14:28:07 user nova-compute[71347]:         <nova:user uuid="797d2d1bff8e4b26afe7856e4c3877cf">tempest-ServerActionsTestJSON-932644409-project-member</nova:user>
Apr 14 14:28:07 user nova-compute[71347]:         <nova:project uuid="3b087f26a80045f3844873220a67a4e4">tempest-ServerActionsTestJSON-932644409</nova:project>
Apr 14 14:28:07 user nova-compute[71347]:       </nova:owner>
Apr 14 14:28:07 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:28:07 user nova-compute[71347]:       <nova:ports>
Apr 14 14:28:07 user nova-compute[71347]:         <nova:port uuid="2eb1d71a-d0d7-473d-9eef-b939fd4b55ef">
Apr 14 14:28:07 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:28:07 user nova-compute[71347]:         </nova:port>
Apr 14 14:28:07 user nova-compute[71347]:       </nova:ports>
Apr 14 14:28:07 user nova-compute[71347]:     </nova:instance>
Apr 14 14:28:07 user nova-compute[71347]:   </metadata>
Apr 14 14:28:07 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:28:07 user nova-compute[71347]:     <system>
Apr 14 14:28:07 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:28:07 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:28:07 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:28:07 user nova-compute[71347]:       <entry name="serial">a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</entry>
Apr 14 14:28:07 user nova-compute[71347]:       <entry name="uuid">a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e</entry>
Apr 14 14:28:07 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:28:07 user nova-compute[71347]:     </system>
Apr 14 14:28:07 user nova-compute[71347]:   </sysinfo>
Apr 14 14:28:07 user nova-compute[71347]:   <os>
Apr 14 14:28:07 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:28:07 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:28:07 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:28:07 user nova-compute[71347]:   </os>
Apr 14 14:28:07 user nova-compute[71347]:   <features>
Apr 14 14:28:07 user nova-compute[71347]:     <acpi/>
Apr 14 14:28:07 user nova-compute[71347]:     <apic/>
Apr 14 14:28:07 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:28:07 user nova-compute[71347]:   </features>
Apr 14 14:28:07 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:28:07 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:28:07 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:28:07 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:28:07 user nova-compute[71347]:   </clock>
Apr 14 14:28:07 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:28:07 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:28:07 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:28:07 user nova-compute[71347]:   </cpu>
Apr 14 14:28:07 user nova-compute[71347]:   <devices>
Apr 14 14:28:07 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:28:07 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:28:07 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk"/>
Apr 14 14:28:07 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:28:07 user nova-compute[71347]:     </disk>
Apr 14 14:28:07 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:28:07 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:28:07 user nova-compute[71347]:       <source dev="/dev/sdc"/>
Apr 14 14:28:07 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:28:07 user nova-compute[71347]:       <serial>4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12</serial>
Apr 14 14:28:07 user nova-compute[71347]:     </disk>
Apr 14 14:28:07 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:28:07 user nova-compute[71347]:       <mac address="fa:16:3e:32:d4:b0"/>
Apr 14 14:28:07 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:28:07 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:28:07 user nova-compute[71347]:       <target dev="tap2eb1d71a-d0"/>
Apr 14 14:28:07 user nova-compute[71347]:     </interface>
Apr 14 14:28:07 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:28:07 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/console.log" append="off"/>
Apr 14 14:28:07 user nova-compute[71347]:     </serial>
Apr 14 14:28:07 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:28:07 user nova-compute[71347]:     <video>
Apr 14 14:28:07 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:28:07 user nova-compute[71347]:     </video>
Apr 14 14:28:07 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:28:07 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:28:07 user nova-compute[71347]:     </rng>
Apr 14 14:28:07 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:28:07 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:28:07 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:28:07 user nova-compute[71347]:     </memballoon>
Apr 14 14:28:07 user nova-compute[71347]:   </devices>
Apr 14 14:28:07 user nova-compute[71347]: </domain>
Apr 14 14:28:07 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG os_vif [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eb1d71a-d0, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eb1d71a-d0, col_values=(('external_ids', {'iface-id': '2eb1d71a-d0d7-473d-9eef-b939fd4b55ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:d4:b0', 'vm-uuid': 'a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:07 user nova-compute[71347]: INFO os_vif [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0')
Apr 14 14:28:07 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:28:07 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:08 user nova-compute[71347]: INFO nova.compute.manager [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Detaching volume ee4fd548-c01c-41ed-a231-433d83cb29da
Apr 14 14:28:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:08 user nova-compute[71347]: INFO nova.virt.block_device [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Attempting to driver detach volume ee4fd548-c01c-41ed-a231-433d83cb29da from mountpoint /dev/vdb
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Attempting to detach device vdb from instance 18a432a7-c206-4cf8-9718-7d5360d97f4e from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:28:08 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:28:08 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:28:08 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:28:08 user nova-compute[71347]:   <serial>ee4fd548-c01c-41ed-a231-433d83cb29da</serial>
Apr 14 14:28:08 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:28:08 user nova-compute[71347]: </disk>
Apr 14 14:28:08 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:28:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Successfully detached device vdb from instance 18a432a7-c206-4cf8-9718-7d5360d97f4e from the persistent domain config.
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18a432a7-c206-4cf8-9718-7d5360d97f4e from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:28:08 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:28:08 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:28:08 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:28:08 user nova-compute[71347]:   <serial>ee4fd548-c01c-41ed-a231-433d83cb29da</serial>
Apr 14 14:28:08 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:28:08 user nova-compute[71347]: </disk>
Apr 14 14:28:08 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updating instance_info_cache with network_info: [{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482488.748656, 18a432a7-c206-4cf8-9718-7d5360d97f4e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:28:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Successfully detached device vdb from instance 18a432a7-c206-4cf8-9718-7d5360d97f4e from the live domain config.
Apr 14 14:28:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHpkVYlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:28:08 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b6c4b-106c-400a-af0e-6035987c5960]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:28:08 user nova-compute[71347]: No targets found.
Apr 14 14:28:08 user nova-compute[71347]: iSNS:
Apr 14 14:28:08 user nova-compute[71347]: No targets found.
Apr 14 14:28:08 user nova-compute[71347]: STATIC:
Apr 14 14:28:08 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da
Apr 14 14:28:08 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:28:08 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:28:08 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:28:08 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:28:08 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:28:08 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:28:08 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:28:08 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:28:08 user nova-compute[71347]: FIRMWARE:
Apr 14 14:28:08 user nova-compute[71347]: No targets found.
Apr 14 14:28:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:28:08 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:28:08 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f194d9fc-91f5-46c0-ac29-827d0200dab8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0717e2-1774-42dd-a2fb-c5696486cc39]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:28:08 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:08 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:28:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da (non-flash)
Apr 14 14:28:08 user nova-compute[71347]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:08 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:28:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4f215a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41080eb-ff25-414c-870a-f4db7c8896ad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a32309-d59b-41cf-8909-b9372a836019]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76d0b4d-c5be-425d-a7c1-45e79c19b0a5]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d54ea0-9845-445f-9704-026c4d481822]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc059de-8208-496b-a9ce-8ce909947437]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f9aa2a-a015-4625-b67f-aa5113062c94]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da, portal: 172.16.0.220,3260]
Apr 14 14:28:09 user nova-compute[71347]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da, portal: 172.16.0.220,3260] successful.
Apr 14 14:28:09 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee4fd548-c01c-41ed-a231-433d83cb29da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc82b3d-71d3-4bbe-8d34-6ab24c1e09e2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] <== disconnect_volume: return (353ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:28:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:28:10 user nova-compute[71347]: WARNING nova.compute.manager [req-55f7bf8c-81bb-495f-82a2-d18733d1decf req-476be56b-cb89-41ed-96d1-6ccb082df22b service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state resized and task_state resize_reverting.
Apr 14 14:28:10 user nova-compute[71347]: DEBUG nova.objects.instance [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'flavor' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8e27b64f-a4bc-41c6-9f31-43ef75b94de6 tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.943s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482491.3569946, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:28:11 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Resumed (Lifecycle Event)
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:28:11 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance running successfully.
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] finish_revert_migration finished successfully. {{(pid=71347) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:28:11 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482491.358847, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:28:11 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Started (Lifecycle Event)
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:28:11 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482476.5722008, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:28:11 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Stopped (Lifecycle Event)
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-42743a1f-c7b1-4986-b5fb-32d1a31c5837 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:28:11 user nova-compute[71347]: INFO nova.compute.manager [None req-e06603fe-24b4-4209-a7c6-77d34e63920a tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance to original state: 'active'
Apr 14 14:28:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-42743a1f-c7b1-4986-b5fb-32d1a31c5837 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:28:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:28:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:28:12 user nova-compute[71347]: WARNING nova.compute.manager [req-51f64e4c-d104-43b1-b8f7-66c611edd841 req-daea02bb-4f4f-4aa6-aed0-a4506c2ba953 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state None.
Apr 14 14:28:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:35 user nova-compute[71347]: INFO nova.compute.manager [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Unshelving
Apr 14 14:28:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:35 user nova-compute[71347]: DEBUG nova.objects.instance [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'pci_requests' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:35 user nova-compute[71347]: DEBUG nova.objects.instance [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'numa_topology' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:35 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:28:35 user nova-compute[71347]: INFO nova.compute.claims [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Claim successful on node user
Apr 14 14:28:35 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:28:35 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:28:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:35 user nova-compute[71347]: INFO nova.network.neutron [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 14:28:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:28:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquired lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:28:36 user nova-compute[71347]: DEBUG nova.network.neutron [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:28:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-changed-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:28:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Refreshing instance network info cache due to event network-changed-72fbb0dc-8b93-4cc7-8ddc-0f7853749614. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:28:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] Acquiring lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Releasing lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:28:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Creating image(s)
Apr 14 14:28:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG nova.objects.instance [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'trusted_certs' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] Acquired lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG nova.network.neutron [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Refreshing network info cache for port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG nova.virt.images [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] 9781b14d-4bb9-43ad-a813-cbb59c6f8989 was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52.part /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updated VIF entry in instance network info cache for port 72fbb0dc-8b93-4cc7-8ddc-0f7853749614. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52.part /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52.converted" returned: 0 in 0.319s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d0bb05d6-73f9-40cf-8126-a0114fb9d657 req-34be0b51-7a8c-46df-abe2-2c6ef68a1a8f service nova] Releasing lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.369s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52 --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52 --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52,backing_fmt=raw /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52,backing_fmt=raw /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk 1073741824" returned: 0 in 0.049s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52 --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:39 user nova-compute[71347]: DEBUG nova.objects.instance [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'migration_context' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Rebasing disk image.
Apr 14 14:28:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d -F raw /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d -F raw /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk" returned: 0 in 1.899s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Ensure instance console log exists: /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Start _get_guest_xml network_info=[{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f9ef558eb8caf78317a206a210afab7f',container_format='bare',created_at=2023-04-14T14:26:42Z,direct_url=<?>,disk_format='qcow2',id=9781b14d-4bb9-43ad-a813-cbb59c6f8989,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1136227517-shelved',owner='b8263321b4e34ea08350e97ac2a3a794',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T14:26:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:28:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:28:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f9ef558eb8caf78317a206a210afab7f',container_format='bare',created_at=2023-04-14T14:26:42Z,direct_url=<?>,disk_format='qcow2',id=9781b14d-4bb9-43ad-a813-cbb59c6f8989,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1136227517-shelved',owner='b8263321b4e34ea08350e97ac2a3a794',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T14:26:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1136227517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1136227517',id=22,image_ref='9781b14d-4bb9-43ad-a813-cbb59c6f8989',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-428673856',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-yy4znehp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member',shelved_at='2023-04-14T14:26:45.501479',shelved_host='user',shelved_image_id='9781b14d-4bb9-43ad-a813-cbb59c6f8989'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:28:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'pci_devices' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:28:41 user nova-compute[71347]:   <uuid>c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e</uuid>
Apr 14 14:28:41 user nova-compute[71347]:   <name>instance-00000016</name>
Apr 14 14:28:41 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:28:41 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:28:41 user nova-compute[71347]:   <metadata>
Apr 14 14:28:41 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:28:41 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:28:41 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1136227517</nova:name>
Apr 14 14:28:41 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:28:41</nova:creationTime>
Apr 14 14:28:41 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:28:41 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:28:41 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:28:41 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:28:41 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:28:41 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:28:41 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:28:41 user nova-compute[71347]:       <nova:owner>
Apr 14 14:28:41 user nova-compute[71347]:         <nova:user uuid="a7a99d9a44334bfeb39f6684853f6844">tempest-AttachVolumeShelveTestJSON-1666709251-project-member</nova:user>
Apr 14 14:28:41 user nova-compute[71347]:         <nova:project uuid="b8263321b4e34ea08350e97ac2a3a794">tempest-AttachVolumeShelveTestJSON-1666709251</nova:project>
Apr 14 14:28:41 user nova-compute[71347]:       </nova:owner>
Apr 14 14:28:41 user nova-compute[71347]:       <nova:root type="image" uuid="9781b14d-4bb9-43ad-a813-cbb59c6f8989"/>
Apr 14 14:28:41 user nova-compute[71347]:       <nova:ports>
Apr 14 14:28:41 user nova-compute[71347]:         <nova:port uuid="72fbb0dc-8b93-4cc7-8ddc-0f7853749614">
Apr 14 14:28:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 14:28:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:28:41 user nova-compute[71347]:       </nova:ports>
Apr 14 14:28:41 user nova-compute[71347]:     </nova:instance>
Apr 14 14:28:41 user nova-compute[71347]:   </metadata>
Apr 14 14:28:41 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:28:41 user nova-compute[71347]:     <system>
Apr 14 14:28:41 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:28:41 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:28:41 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:28:41 user nova-compute[71347]:       <entry name="serial">c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e</entry>
Apr 14 14:28:41 user nova-compute[71347]:       <entry name="uuid">c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e</entry>
Apr 14 14:28:41 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:28:41 user nova-compute[71347]:     </system>
Apr 14 14:28:41 user nova-compute[71347]:   </sysinfo>
Apr 14 14:28:41 user nova-compute[71347]:   <os>
Apr 14 14:28:41 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:28:41 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:28:41 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:28:41 user nova-compute[71347]:   </os>
Apr 14 14:28:41 user nova-compute[71347]:   <features>
Apr 14 14:28:41 user nova-compute[71347]:     <acpi/>
Apr 14 14:28:41 user nova-compute[71347]:     <apic/>
Apr 14 14:28:41 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:28:41 user nova-compute[71347]:   </features>
Apr 14 14:28:41 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:28:41 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:28:41 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:28:41 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:28:41 user nova-compute[71347]:   </clock>
Apr 14 14:28:41 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:28:41 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:28:41 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:28:41 user nova-compute[71347]:   </cpu>
Apr 14 14:28:41 user nova-compute[71347]:   <devices>
Apr 14 14:28:41 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:28:41 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:28:41 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk"/>
Apr 14 14:28:41 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:28:41 user nova-compute[71347]:     </disk>
Apr 14 14:28:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:28:41 user nova-compute[71347]:       <mac address="fa:16:3e:ec:6c:a2"/>
Apr 14 14:28:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:28:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:28:41 user nova-compute[71347]:       <target dev="tap72fbb0dc-8b"/>
Apr 14 14:28:41 user nova-compute[71347]:     </interface>
Apr 14 14:28:41 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:28:41 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/console.log" append="off"/>
Apr 14 14:28:41 user nova-compute[71347]:     </serial>
Apr 14 14:28:41 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:28:41 user nova-compute[71347]:     <video>
Apr 14 14:28:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:28:41 user nova-compute[71347]:     </video>
Apr 14 14:28:41 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:28:41 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:28:41 user nova-compute[71347]:     </rng>
Apr 14 14:28:41 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:28:41 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:28:41 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:28:41 user nova-compute[71347]:     </memballoon>
Apr 14 14:28:41 user nova-compute[71347]:   </devices>
Apr 14 14:28:41 user nova-compute[71347]: </domain>
Apr 14 14:28:41 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1136227517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1136227517',id=22,image_ref='9781b14d-4bb9-43ad-a813-cbb59c6f8989',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-428673856',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-yy4znehp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member',shelved_at='2023-04-14T14:26:45.501479',shelved_host='user',shelved_image_id='9781b14d-4bb9-43ad-a813-cbb59c6f8989'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:28:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG os_vif [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72fbb0dc-8b, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72fbb0dc-8b, col_values=(('external_ids', {'iface-id': '72fbb0dc-8b93-4cc7-8ddc-0f7853749614', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:6c:a2', 'vm-uuid': 'c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:41 user nova-compute[71347]: INFO os_vif [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b')
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:28:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] No VIF found with MAC fa:16:3e:ec:6c:a2, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:28:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] No waiting events found dispatching network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:28:43 user nova-compute[71347]: WARNING nova.compute.manager [req-a01d4fcd-4712-4837-b554-0ba654256b0c req-97775558-4c6e-4539-a978-d27e3d73bf21 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received unexpected event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 14:28:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:44 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482524.861871, c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:28:44 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] VM Resumed (Lifecycle Event)
Apr 14 14:28:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:28:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:28:44 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance spawned successfully.
Apr 14 14:28:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:28:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:28:44 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:28:44 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482524.8637629, c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:28:44 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] VM Started (Lifecycle Event)
Apr 14 14:28:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:28:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:28:44 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:28:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:28:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] No waiting events found dispatching network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:28:45 user nova-compute[71347]: WARNING nova.compute.manager [req-aa6823c9-02a1-4a13-8529-7062d992337a req-5b6c1cbf-9f7e-46b8-b229-1f4b5ebfcde3 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received unexpected event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 14:28:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:28:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-06a68ab1-75dd-4c79-898f-bff06bd64c1c tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.127s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'flavor' on Instance uuid 5e419ecb-c1e3-4713-a190-62a7f220d01a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:46 user nova-compute[71347]: INFO nova.compute.manager [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Attaching volume 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 to /dev/vdb
Apr 14 14:28:46 user nova-compute[71347]: DEBUG os_brick.utils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[48549ae8-eb50-4c60-bd28-a51d8b2975f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a3d81a-bc9d-45a9-87c8-4e4531089332]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[582dfce8-6e19-4306-8cd9-88b045e41185]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b522e3-bba9-48c4-b0fe-a3e3dc514678]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:28:46 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:28:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a085744b-a549-482f-be5c-43c8f8938865]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG os_brick.utils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:28:46 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating existing volume attachment record: f66f40a5-5fd5-461f-a8c6-c7011002de75 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:28:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvjTsyKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:28:51 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:28:51 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:28:51 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f25381-4847-4913-bfbd-68dc5c522685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:28:51 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b68a77-1ce7-4d71-8e92-3ef153ce7155]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32] added
Apr 14 14:28:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe0fbf7-70a2-41ac-b732-da3a212b0602]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d3fbb-6e24-4a40-8fc8-0c15bfc4d354]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FvjTsyKn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FvjTsyKn" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43a355-56bd-4351-9207-a41a9d9e1f9f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FvjTsyKn'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f7df1d-70a4-4fc9-b5bf-2aeaa562ae9e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5380d8f1-955a-4c4f-98e9-aa6f73f28b8f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbe1b24-89d7-4baa-9688-a1db8a0a73fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32, portal: 172.16.0.220,3260]
Apr 14 14:28:51 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32, portal: 172.16.0.220,3260] successful.
Apr 14 14:28:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8463574-a41b-46fd-9c6a-3260d2db84bb]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f13f40-c1e4-47cf-bad9-d04730b2cd90]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:28:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00ecc72-b660-432a-bc35-2525c01bd4f4]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:28:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvjTsyKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:28:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:28:52 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23238663234623164', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:28:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238663234623164', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:28:52 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'flavor' on Instance uuid 5e419ecb-c1e3-4713-a190-62a7f220d01a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:28:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:28:52 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:28:52 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:28:52 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:28:52 user nova-compute[71347]:   <serial>5f94c09b-5ac0-4fcb-81f1-996b7e7aed32</serial>
Apr 14 14:28:52 user nova-compute[71347]: </disk>
Apr 14 14:28:52 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:28:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:28:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:28:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] No VIF found with MAC fa:16:3e:58:e9:07, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:28:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ffdb4549-76bb-4beb-81cb-83ea329cdc29 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.680s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:28:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-changed-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:28:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing instance network info cache due to event network-changed-017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:28:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] Acquiring lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:28:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] Acquired lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:28:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing network info cache for port 017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:28:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updated VIF entry in instance network info cache for port 017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:28:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating instance_info_cache with network_info: [{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:28:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-078bf315-1486-4ab5-8419-8c4ae41f142f req-08ec5e7c-6ae6-40ff-9d38-26202e1c268a service nova] Releasing lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:28:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-changed-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:28:57 user nova-compute[71347]: DEBUG nova.compute.manager [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing instance network info cache due to event network-changed-017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:28:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] Acquiring lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:28:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] Acquired lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:28:57 user nova-compute[71347]: DEBUG nova.network.neutron [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing network info cache for port 017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:28:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:28:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:28:58 user nova-compute[71347]: INFO nova.compute.manager [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Rebooting instance
Apr 14 14:28:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:28:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:28:58 user nova-compute[71347]: DEBUG nova.network.neutron [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updated VIF entry in instance network info cache for port 017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:28:58 user nova-compute[71347]: DEBUG nova.network.neutron [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating instance_info_cache with network_info: [{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:28:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9dde8e80-d52a-421d-8638-9f795868a33a req-47cc1326-6a51-407f-bfaf-d27f1cc214cd service nova] Releasing lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:28:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquired lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:28:58 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:28:59 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating instance_info_cache with network_info: [{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:28:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Releasing lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:28:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-unplugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] No waiting events found dispatching network-vif-unplugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:01 user nova-compute[71347]: WARNING nova.compute.manager [req-c214a9f5-32d8-4984-9d77-64d827effd01 req-d2f70a4d-55b8-47aa-87a3-ae8f0472700c service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received unexpected event network-vif-unplugged-017c2389-4552-4847-9195-84fe74787c99 for instance with vm_state active and task_state reboot_started.
Apr 14 14:29:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:02 user nova-compute[71347]: INFO nova.compute.manager [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Terminating instance
Apr 14 14:29:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Instance shutdown successfully.
Apr 14 14:29:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-f839e4a8-a3da-40db-abb3-fd78e88f4a33 req-93dcdd41-5360-4aa5-848a-f0d26e388374 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Instance destroyed successfully.
Apr 14 14:29:03 user nova-compute[71347]: DEBUG nova.objects.instance [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lazy-loading 'resources' on Instance uuid 18a432a7-c206-4cf8-9718-7d5360d97f4e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-393140121',display_name='tempest-ServerStableDeviceRescueTest-server-393140121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-393140121',id=18,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcG6CGdcPTxnc20cAT09PWltwZ9dV2VmciF9n8/6ntZku9choOWtWjG4TaYyDwwi97Q7GgJIEVXlDOgWGZq3YI+oL07LY/8GN78RAWAGwVdDlzGqza6dkL5xCOnG2giNA==',key_name='tempest-keypair-1665568620',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b661ed41a346a487e0b47ce2c2af13',ramdisk_id='',reservation_id='r-usawgxs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-339063849',owner_user_name='tempest-ServerStableDeviceRescueTest-339063849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:27:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f64d891eb758466888e7ca9550994511',uuid=18a432a7-c206-4cf8-9718-7d5360d97f4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Converting VIF {"id": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "address": "fa:16:3e:22:e2:92", "network": {"id": "eebad641-c9f2-4ff8-8655-6019ac289951", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-230158986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b661ed41a346a487e0b47ce2c2af13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc6a8af0-4a", "ovs_interfaceid": "fc6a8af0-4a67-4942-9548-41928d3f3f5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:92,bridge_name='br-int',has_traffic_filtering=True,id=fc6a8af0-4a67-4942-9548-41928d3f3f5d,network=Network(eebad641-c9f2-4ff8-8655-6019ac289951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc6a8af0-4a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG os_vif [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:92,bridge_name='br-int',has_traffic_filtering=True,id=fc6a8af0-4a67-4942-9548-41928d3f3f5d,network=Network(eebad641-c9f2-4ff8-8655-6019ac289951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc6a8af0-4a') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc6a8af0-4a, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: INFO os_vif [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:e2:92,bridge_name='br-int',has_traffic_filtering=True,id=fc6a8af0-4a67-4942-9548-41928d3f3f5d,network=Network(eebad641-c9f2-4ff8-8655-6019ac289951),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc6a8af0-4a')
Apr 14 14:29:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Deleting instance files /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e_del
Apr 14 14:29:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Deletion of /opt/stack/data/nova/instances/18a432a7-c206-4cf8-9718-7d5360d97f4e_del complete
Apr 14 14:29:03 user nova-compute[71347]: INFO nova.compute.manager [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 14 14:29:03 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] No waiting events found dispatching network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:03 user nova-compute[71347]: WARNING nova.compute.manager [req-8d90b41f-cd2c-4780-b3b1-0c23ae7cae27 req-80422169-6138-4e66-a2a6-74259a1fb528 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received unexpected event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 for instance with vm_state active and task_state reboot_started.
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:29:04 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Took 1.01 seconds to deallocate network for instance.
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-deleted-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:04 user nova-compute[71347]: INFO nova.compute.manager [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Neutron deleted interface fc6a8af0-4a67-4942-9548-41928d3f3f5d; detaching it from the instance and deleting it from the info cache
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.network.neutron [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-8b1c1aee-535f-483f-a6a9-a222399d6823 req-b957368e-deaa-4e42-b2c7-1b18921cad40 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Detach interface failed, port_id=fc6a8af0-4a67-4942-9548-41928d3f3f5d, reason: Instance 18a432a7-c206-4cf8-9718-7d5360d97f4e could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:04 user nova-compute[71347]: WARNING nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state deleted and task_state None.
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:04 user nova-compute[71347]: WARNING nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state deleted and task_state None.
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:04 user nova-compute[71347]: WARNING nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state deleted and task_state None.
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:04 user nova-compute[71347]: WARNING nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-unplugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state deleted and task_state None.
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Acquiring lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] No waiting events found dispatching network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:04 user nova-compute[71347]: WARNING nova.compute.manager [req-f0abe913-2ec7-4d59-8b6f-11711d3c0699 req-4d6fa162-ebe6-40b7-96c2-7e2de0650f54 service nova] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Received unexpected event network-vif-plugged-fc6a8af0-4a67-4942-9548-41928d3f3f5d for instance with vm_state deleted and task_state None.
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:29:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:05 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Deleted allocations for instance 18a432a7-c206-4cf8-9718-7d5360d97f4e
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-20ec7a52-ec2a-4c31-b928-ecedd1d6f87d tempest-ServerStableDeviceRescueTest-339063849 tempest-ServerStableDeviceRescueTest-339063849-project-member] Lock "18a432a7-c206-4cf8-9718-7d5360d97f4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.181s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] No waiting events found dispatching network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:05 user nova-compute[71347]: WARNING nova.compute.manager [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received unexpected event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 for instance with vm_state active and task_state reboot_started.
Apr 14 14:29:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] No waiting events found dispatching network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:05 user nova-compute[71347]: WARNING nova.compute.manager [req-ce97a860-987b-4cf7-91cb-790139745150 req-5c00fb3a-d923-448c-9854-0a0afad32f79 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received unexpected event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 for instance with vm_state active and task_state reboot_started.
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 5e419ecb-c1e3-4713-a190-62a7f220d01a due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482546.2244732, 5e419ecb-c1e3-4713-a190-62a7f220d01a => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:29:06 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] VM Resumed (Lifecycle Event)
Apr 14 14:29:06 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Instance running successfully.
Apr 14 14:29:06 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Instance soft rebooted successfully.
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:29:06 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482546.2258065, 5e419ecb-c1e3-4713-a190-62a7f220d01a => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:29:06 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] VM Started (Lifecycle Event)
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e6e2c15d-ce07-4448-9641-c6e1d1c191fa tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.177s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:08 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:29:08 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7641MB free_disk=26.34963607788086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 8ba61f44-8536-4642-8d41-07ded8c58e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fc7da5e7-7b87-458f-82b1-055664003a85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:29:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:29:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:29:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:29:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:29:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [{"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:29:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:29:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:29:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:29:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8ba61f44-8536-4642-8d41-07ded8c58e1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:14 user nova-compute[71347]: INFO nova.compute.manager [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Terminating instance
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received event network-vif-unplugged-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] Acquiring lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] No waiting events found dispatching network-vif-unplugged-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-0f3e6a07-6173-4276-94ae-97341a119ad4 req-688e0e36-0fb5-41c7-ab75-58c658203a21 service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received event network-vif-unplugged-80e312fb-30d9-4faa-9752-dedbe93524f1 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:29:14 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Instance destroyed successfully.
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lazy-loading 'resources' on Instance uuid 8ba61f44-8536-4642-8d41-07ded8c58e1b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1293967311',display_name='tempest-VolumesActionsTest-instance-1293967311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1293967311',id=25,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:27:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd6ef742f6534538a9452fe0d4ddce56',ramdisk_id='',reservation_id='r-04akxtad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1447608595',owner_user_name='tempest-VolumesActionsTest-1447608595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:27:31Z,user_data=None,user_id='2de5e6883ff54d049fba7810fe4f1f38',uuid=8ba61f44-8536-4642-8d41-07ded8c58e1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converting VIF {"id": "80e312fb-30d9-4faa-9752-dedbe93524f1", "address": "fa:16:3e:34:98:41", "network": {"id": "9edb5ed2-1710-4203-821d-23e54cf33690", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1308667182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cd6ef742f6534538a9452fe0d4ddce56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e312fb-30", "ovs_interfaceid": "80e312fb-30d9-4faa-9752-dedbe93524f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:98:41,bridge_name='br-int',has_traffic_filtering=True,id=80e312fb-30d9-4faa-9752-dedbe93524f1,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e312fb-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG os_vif [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:98:41,bridge_name='br-int',has_traffic_filtering=True,id=80e312fb-30d9-4faa-9752-dedbe93524f1,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e312fb-30') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80e312fb-30, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:14 user nova-compute[71347]: INFO os_vif [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:98:41,bridge_name='br-int',has_traffic_filtering=True,id=80e312fb-30d9-4faa-9752-dedbe93524f1,network=Network(9edb5ed2-1710-4203-821d-23e54cf33690),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e312fb-30')
Apr 14 14:29:14 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Deleting instance files /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b_del
Apr 14 14:29:14 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Deletion of /opt/stack/data/nova/instances/8ba61f44-8536-4642-8d41-07ded8c58e1b_del complete
Apr 14 14:29:14 user nova-compute[71347]: INFO nova.compute.manager [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 14:29:14 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:29:14 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:29:15 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:29:15 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Took 0.73 seconds to deallocate network for instance.
Apr 14 14:29:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-c8db6dbe-d449-4475-8acf-a01fbfd8da9d req-7da45cea-2e05-4eec-930c-f06f1d72f27f service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received event network-vif-deleted-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:15 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:29:15 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:29:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:15 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Deleted allocations for instance 8ba61f44-8536-4642-8d41-07ded8c58e1b
Apr 14 14:29:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b4bf2f63-f822-41df-892f-034c0232a88b tempest-VolumesActionsTest-1447608595 tempest-VolumesActionsTest-1447608595-project-member] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.907s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received event network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] Acquiring lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] Lock "8ba61f44-8536-4642-8d41-07ded8c58e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] No waiting events found dispatching network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:16 user nova-compute[71347]: WARNING nova.compute.manager [req-e7d4623d-3b4b-4742-bc6a-a842773af2b6 req-cc4b7321-8009-4dff-a7df-04a62c4015ea service nova] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Received unexpected event network-vif-plugged-80e312fb-30d9-4faa-9752-dedbe93524f1 for instance with vm_state deleted and task_state None.
Apr 14 14:29:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:18 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482543.2926142, 18a432a7-c206-4cf8-9718-7d5360d97f4e => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:29:18 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] VM Stopped (Lifecycle Event)
Apr 14 14:29:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ce6f6d13-8faa-4f6a-bdba-375111912da5 None None] [instance: 18a432a7-c206-4cf8-9718-7d5360d97f4e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:26 user nova-compute[71347]: INFO nova.compute.manager [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Unrescuing
Apr 14 14:29:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:29:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquired lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:29:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating instance_info_cache with network_info: [{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Releasing lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG nova.objects.instance [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'flavor' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:27 user nova-compute[71347]: WARNING nova.compute.manager [req-7ab66f4c-a32e-405e-b69b-187f22dc3d15 req-0b9c4a1d-ba87-46c4-be74-947068c30e4d service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:29:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:27 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance destroyed successfully.
Apr 14 14:29:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482554.6364565, 8ba61f44-8536-4642-8d41-07ded8c58e1b => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:29:29 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] VM Stopped (Lifecycle Event)
Apr 14 14:29:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a5220158-22a5-41e1-88e1-3ee6107f2e4f None None] [instance: 8ba61f44-8536-4642-8d41-07ded8c58e1b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:29 user nova-compute[71347]: WARNING nova.compute.manager [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:29:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:29 user nova-compute[71347]: WARNING nova.compute.manager [req-5bf06ca9-e950-4ba7-bc48-a611fba319b4 req-9a4f3445-8b01-4dae-9792-7d388cf7fbb8 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482571.504032, fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:29:31 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] VM Resumed (Lifecycle Event)
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-66fbaa4b-8c83-450c-bd69-2f8312cf852e tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:29:31 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482571.5057244, fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:29:31 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] VM Started (Lifecycle Event)
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:31 user nova-compute[71347]: WARNING nova.compute.manager [req-9ebbe3ed-92e1-4f23-a29a-439e9bb866e0 req-261bf55e-6881-4e32-91e2-2aa1c5bd5043 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state active and task_state None.
Apr 14 14:29:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received event network-changed-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Refreshing instance network info cache due to event network-changed-4a9de01b-07a4-4bcf-933f-3d493bae2db1. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] Acquiring lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] Acquired lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Refreshing network info cache for port 4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Updated VIF entry in instance network info cache for port 4a9de01b-07a4-4bcf-933f-3d493bae2db1. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Updating instance_info_cache with network_info: [{"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:29:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b1098290-4b46-45c9-8cdd-e74f7ec9118b req-21d6c309-27e1-4ffe-9c50-3516d0ad37f8 service nova] Releasing lock "refresh_cache-4fa04501-bc13-4309-b3a2-d972e2fc7c93" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:29:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:42 user nova-compute[71347]: INFO nova.compute.manager [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Attaching volume a48016c4-11da-4f55-83f8-1104581bd49e to /dev/vdb
Apr 14 14:29:42 user nova-compute[71347]: DEBUG os_brick.utils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e645aa8f-cf4a-4e4f-9b66-9de91e6260ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887b458-d3ca-4003-8a3e-7535932a0e90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627157e-1cc3-4c70-8759-a86a160a48e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e825ffd-316c-41c7-bee2-f218749d8aee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:29:42 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:29:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c986e-d941-454d-a94f-9c4f37448581]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG os_brick.utils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:29:42 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Updating existing volume attachment record: dcc9c45b-9231-4bf2-b578-073d435eb271 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-changed-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Refreshing instance network info cache due to event network-changed-b7a7cf30-86d8-48d3-a117-887a3bdc342b. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] Acquiring lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] Acquired lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Refreshing network info cache for port b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'flavor' on Instance uuid fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:43 user nova-compute[71347]: INFO nova.compute.manager [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Attaching volume 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d to /dev/vdb
Apr 14 14:29:43 user nova-compute[71347]: DEBUG os_brick.utils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d1d6b6-376f-4037-bd46-aec4a4b15174]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caf1cf4-3d38-40e4-b35d-b0a3ddc4f3f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[73138035-51c5-418f-b613-f067b906febc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3641232-3b1e-4e37-8d7e-b69a1ef99051]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updated VIF entry in instance network info cache for port b7a7cf30-86d8-48d3-a117-887a3bdc342b. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updating instance_info_cache with network_info: [{"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:29:44 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9725f9-cd7c-42b7-b77c-3f0c5a3b565d]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG os_brick.utils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updating existing volume attachment record: 3cf4a9e7-7ea7-4799-8787-8375fcc4ebc7 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0e52622-8a16-4ae3-a66c-bad2d6d45b35 req-38ad7172-2c9f-4e37-9cff-bd21708a5591 service nova] Releasing lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:29:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquired lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'info_cache' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlTUqorn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:29:46 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:29:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:29:46 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:29:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:29:46 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e1e20-77a1-49ac-96ee-d846659c3c6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:29:46 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bc63b6-a1c1-4ddf-bbe3-80baac22997e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e] added
Apr 14 14:29:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec53703-0b2b-430c-a05f-a2e4b200ecef]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fed6324-4463-427a-b434-1ec8ffc62cab]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YlTUqorn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YlTUqorn" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7eb22b-411b-4340-a009-b5caeed487ec]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YlTUqorn'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa48b1f1-ea00-42b5-ab92-602879ac1139]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updating instance_info_cache with network_info: [{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Releasing lock "refresh_cache-a3faeeb1-a50c-474b-b694-98c4d70435d5" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3931c23a-986d-4195-9817-e51e09963133]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance destroyed successfully.
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'resources' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_vif [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e2789a-8cdf-4d63-9624-841fa3a60cee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e, portal: 172.16.0.220,3260]
Apr 14 14:29:47 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e, portal: 172.16.0.220,3260] successful.
Apr 14 14:29:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap693b3793-ec, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:29:47 user nova-compute[71347]: INFO os_vif [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec')
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Start _get_guest_xml network_info=[{"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'numa_topology' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece796d-5137-44b0-9d4b-5be00d6567c4]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:29:47 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b0b7f4-a556-4e9b-a47e-667cc602fa5a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)
Apr 14 14:29:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:47 user nova-compute[71347]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)
Apr 14 14:29:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'pci_devices' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee23a7bf-178a-47e5-b362-030b4756f631]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlTUqorn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:29:47 user nova-compute[71347]:   <uuid>a3faeeb1-a50c-474b-b694-98c4d70435d5</uuid>
Apr 14 14:29:47 user nova-compute[71347]:   <name>instance-00000013</name>
Apr 14 14:29:47 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:29:47 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:29:47 user nova-compute[71347]:   <metadata>
Apr 14 14:29:47 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:29:47 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:29:47 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeTestJSON-server-398425278</nova:name>
Apr 14 14:29:47 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:29:47</nova:creationTime>
Apr 14 14:29:47 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:29:47 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:29:47 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:29:47 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:29:47 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:29:47 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:29:47 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:29:47 user nova-compute[71347]:       <nova:owner>
Apr 14 14:29:47 user nova-compute[71347]:         <nova:user uuid="303cb0475ae74f328ee503d1e9d1f652">tempest-AttachVolumeTestJSON-1787222284-project-member</nova:user>
Apr 14 14:29:47 user nova-compute[71347]:         <nova:project uuid="6dd9adda27714cf5b55203d8d76de05a">tempest-AttachVolumeTestJSON-1787222284</nova:project>
Apr 14 14:29:47 user nova-compute[71347]:       </nova:owner>
Apr 14 14:29:47 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:29:47 user nova-compute[71347]:       <nova:ports>
Apr 14 14:29:47 user nova-compute[71347]:         <nova:port uuid="693b3793-ec24-4c90-ba05-73d5e4eaa30f">
Apr 14 14:29:47 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 14:29:47 user nova-compute[71347]:         </nova:port>
Apr 14 14:29:47 user nova-compute[71347]:       </nova:ports>
Apr 14 14:29:47 user nova-compute[71347]:     </nova:instance>
Apr 14 14:29:47 user nova-compute[71347]:   </metadata>
Apr 14 14:29:47 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:29:47 user nova-compute[71347]:     <system>
Apr 14 14:29:47 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:29:47 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:29:47 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:29:47 user nova-compute[71347]:       <entry name="serial">a3faeeb1-a50c-474b-b694-98c4d70435d5</entry>
Apr 14 14:29:47 user nova-compute[71347]:       <entry name="uuid">a3faeeb1-a50c-474b-b694-98c4d70435d5</entry>
Apr 14 14:29:47 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:29:47 user nova-compute[71347]:     </system>
Apr 14 14:29:47 user nova-compute[71347]:   </sysinfo>
Apr 14 14:29:47 user nova-compute[71347]:   <os>
Apr 14 14:29:47 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:29:47 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:29:47 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:29:47 user nova-compute[71347]:   </os>
Apr 14 14:29:47 user nova-compute[71347]:   <features>
Apr 14 14:29:47 user nova-compute[71347]:     <acpi/>
Apr 14 14:29:47 user nova-compute[71347]:     <apic/>
Apr 14 14:29:47 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:29:47 user nova-compute[71347]:   </features>
Apr 14 14:29:47 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:29:47 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:29:47 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:29:47 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:29:47 user nova-compute[71347]:   </clock>
Apr 14 14:29:47 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:29:47 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:29:47 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:29:47 user nova-compute[71347]:   </cpu>
Apr 14 14:29:47 user nova-compute[71347]:   <devices>
Apr 14 14:29:47 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:29:47 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:29:47 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk"/>
Apr 14 14:29:47 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:29:47 user nova-compute[71347]:     </disk>
Apr 14 14:29:47 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:29:47 user nova-compute[71347]:       <mac address="fa:16:3e:39:a0:32"/>
Apr 14 14:29:47 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:29:47 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:29:47 user nova-compute[71347]:       <target dev="tap693b3793-ec"/>
Apr 14 14:29:47 user nova-compute[71347]:     </interface>
Apr 14 14:29:47 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:29:47 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/console.log" append="off"/>
Apr 14 14:29:47 user nova-compute[71347]:     </serial>
Apr 14 14:29:47 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:29:47 user nova-compute[71347]:     <video>
Apr 14 14:29:47 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:29:47 user nova-compute[71347]:     </video>
Apr 14 14:29:47 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:29:47 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:29:47 user nova-compute[71347]:     </rng>
Apr 14 14:29:47 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:29:47 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:29:47 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:29:47 user nova-compute[71347]:     </memballoon>
Apr 14 14:29:47 user nova-compute[71347]:   </devices>
Apr 14 14:29:47 user nova-compute[71347]: </domain>
Apr 14 14:29:47 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'trusted_certs' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Cannot resize image /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'migration_context' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:27:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG os_vif [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap693b3793-ec, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap693b3793-ec, col_values=(('external_ids', {'iface-id': '693b3793-ec24-4c90-ba05-73d5e4eaa30f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:a0:32', 'vm-uuid': 'a3faeeb1-a50c-474b-b694-98c4d70435d5'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:29:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:47 user nova-compute[71347]: INFO os_vif [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec')
Apr 14 14:29:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26563616661333062', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563616661333062', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG nova.objects.instance [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:29:48 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:29:48 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:29:48 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:29:48 user nova-compute[71347]:   <serial>a48016c4-11da-4f55-83f8-1104581bd49e</serial>
Apr 14 14:29:48 user nova-compute[71347]: </disk>
Apr 14 14:29:48 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTPXUGve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:29:48 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:29:48 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:29:48 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc07aef-1763-400f-880c-448d4467d709]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:29:48 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6fabb-7af3-413f-8928-0665a3eb5034]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d] added
Apr 14 14:29:48 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad861c29-a1b5-4e83-99a1-ca0efbb958eb]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3dd8d-b4ed-47d9-b942-24371529074d]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTPXUGve {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTPXUGve" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c907757d-e88d-4110-946b-152a55a704cf]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTPXUGve'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f77228-47a6-4f2a-a79a-3daff2df29cc]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1908f3f9-fb29-489f-81e0-b801f9c80b33]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:48 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:48 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:48 user nova-compute[71347]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)
Apr 14 14:29:48 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:48 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:48 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:48 user nova-compute[71347]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)
Apr 14 14:29:48 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:29:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c93b0b-a6fc-4285-8a0e-21288126e0ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d, portal: 172.16.0.220,3260]
Apr 14 14:29:49 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d, portal: 172.16.0.220,3260] successful.
Apr 14 14:29:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a06731-ba6a-49d5-b4cf-55a0d1e22986]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09a987-bdae-467e-89f2-0a92d417ebb9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:49 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:49 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:49 user nova-compute[71347]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)
Apr 14 14:29:49 user nova-compute[71347]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)
Apr 14 14:29:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:49 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:49 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:49 user nova-compute[71347]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)
Apr 14 14:29:49 user nova-compute[71347]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)
Apr 14 14:29:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740f41b-d474-47a2-bdce-7f5005221684]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTPXUGve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No VIF found with MAC fa:16:3e:c8:98:7d, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1de4480e-c6c5-4303-ada6-5060553f4232 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.320s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:49 user nova-compute[71347]: WARNING nova.compute.manager [req-f7ee7e1e-ba40-407d-bb48-4ee71e2cdbef req-c1813c9a-c69d-46e8-a336-49ba6fc4689c service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state stopped and task_state powering-on.
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26237623464653163', 'path': '/dev/sdf'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237623464653163', 'path': '/dev/sdf'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'flavor' on Instance uuid fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:29:50 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:29:50 user nova-compute[71347]:   <source dev="/dev/sdf"/>
Apr 14 14:29:50 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:29:50 user nova-compute[71347]:   <serial>7e8ef61f-fc6b-47dc-99ad-79c2470ef08d</serial>
Apr 14 14:29:50 user nova-compute[71347]: </disk>
Apr 14 14:29:50 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:50 user nova-compute[71347]: INFO nova.compute.manager [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Detaching volume a48016c4-11da-4f55-83f8-1104581bd49e
Apr 14 14:29:50 user nova-compute[71347]: INFO nova.virt.block_device [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Attempting to driver detach volume a48016c4-11da-4f55-83f8-1104581bd49e from mountpoint /dev/vdb
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Attempting to detach device vdb from instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:29:50 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:29:50 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:29:50 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:29:50 user nova-compute[71347]:   <serial>a48016c4-11da-4f55-83f8-1104581bd49e</serial>
Apr 14 14:29:50 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:29:50 user nova-compute[71347]: </disk>
Apr 14 14:29:50 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:29:50 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully detached device vdb from instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 from the persistent domain config.
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:29:50 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:29:50 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:29:50 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:29:50 user nova-compute[71347]:   <serial>a48016c4-11da-4f55-83f8-1104581bd49e</serial>
Apr 14 14:29:50 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:29:50 user nova-compute[71347]: </disk>
Apr 14 14:29:50 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No VIF found with MAC fa:16:3e:c4:8c:44, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e51a5fcb-b701-45fb-adc3-466c44d2d59d tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.769s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482590.7468615, 4fa04501-bc13-4309-b3a2-d972e2fc7c93 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:29:50 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully detached device vdb from instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 from the live domain config.
Apr 14 14:29:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlTUqorn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:29:50 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73eeb19-0116-4f14-a85e-84677d70866f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:29:50 user nova-compute[71347]: No targets found.
Apr 14 14:29:50 user nova-compute[71347]: iSNS:
Apr 14 14:29:50 user nova-compute[71347]: No targets found.
Apr 14 14:29:50 user nova-compute[71347]: STATIC:
Apr 14 14:29:50 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d
Apr 14 14:29:50 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:50 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:50 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32
Apr 14 14:29:50 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:50 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:50 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e
Apr 14 14:29:50 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:50 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:50 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:29:50 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:50 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:50 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:29:50 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:50 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:50 user nova-compute[71347]: FIRMWARE:
Apr 14 14:29:50 user nova-compute[71347]: No targets found.
Apr 14 14:29:50 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:29:50 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:29:50 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f4901e-3b18-4ad9-b2da-53c015e18682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d494e51-465a-4cd1-ac1d-fdc7a5d4e9d4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:50 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:50 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:50 user nova-compute[71347]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)
Apr 14 14:29:50 user nova-compute[71347]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)
Apr 14 14:29:50 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:50 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:50 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:50 user nova-compute[71347]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e (non-flash)
Apr 14 14:29:50 user nova-compute[71347]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)
Apr 14 14:29:50 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5005620ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692e81f-f134-4e08-9d84-e2fb7f54e352]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be69af7-0c88-4802-8e89-36389ad61a82]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e269392-be7e-4cb6-8cd5-ee72e281a3be]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0cebe5-2333-45fd-a770-422af6441b05]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6abf6b6-d523-4dbe-b44c-0bc1b17181bc]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5297b9-585a-482c-af91-fb223bd3b9f9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e, portal: 172.16.0.220,3260]
Apr 14 14:29:51 user nova-compute[71347]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e, portal: 172.16.0.220,3260] successful.
Apr 14 14:29:51 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a48016c4-11da-4f55-83f8-1104581bd49e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca765be-b176-41cb-b76f-f9da15fcb317]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== disconnect_volume: return (326ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482591.804434, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:29:51 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Resumed (Lifecycle Event)
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:29:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance rebooted successfully.
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b9467253-c460-4a10-91c8-c7fa03eab4a4 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:29:51 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482591.8066742, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:29:51 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Started (Lifecycle Event)
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:29:51 user nova-compute[71347]: WARNING nova.compute.manager [req-e22d86fc-f218-4e16-814b-25815cf4e95f req-748c3fc6-a2ab-41a3-a5b7-b0dfb7c35d8b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state stopped and task_state powering-on.
Apr 14 14:29:51 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5ce5df5a-c894-4eff-b35c-bc6043126c95 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.787s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:29:53 user nova-compute[71347]: INFO nova.compute.manager [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Detaching volume 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d
Apr 14 14:29:53 user nova-compute[71347]: INFO nova.virt.block_device [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Attempting to driver detach volume 7e8ef61f-fc6b-47dc-99ad-79c2470ef08d from mountpoint /dev/vdb
Apr 14 14:29:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Attempting to detach device vdb from instance fc7da5e7-7b87-458f-82b1-055664003a85 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:29:53 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:29:53 user nova-compute[71347]:   <source dev="/dev/sdf"/>
Apr 14 14:29:53 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:29:53 user nova-compute[71347]:   <serial>7e8ef61f-fc6b-47dc-99ad-79c2470ef08d</serial>
Apr 14 14:29:53 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:29:53 user nova-compute[71347]: </disk>
Apr 14 14:29:53 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:29:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Successfully detached device vdb from instance fc7da5e7-7b87-458f-82b1-055664003a85 from the persistent domain config.
Apr 14 14:29:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc7da5e7-7b87-458f-82b1-055664003a85 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:29:53 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:29:53 user nova-compute[71347]:   <source dev="/dev/sdf"/>
Apr 14 14:29:53 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:29:53 user nova-compute[71347]:   <serial>7e8ef61f-fc6b-47dc-99ad-79c2470ef08d</serial>
Apr 14 14:29:53 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:29:53 user nova-compute[71347]: </disk>
Apr 14 14:29:53 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482593.8839824, fc7da5e7-7b87-458f-82b1-055664003a85 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:29:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Successfully detached device vdb from instance fc7da5e7-7b87-458f-82b1-055664003a85 from the live domain config.
Apr 14 14:29:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTPXUGve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:29:53 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34c3a78-0ed5-4fbf-b3f2-84e2e52229ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:29:53 user nova-compute[71347]: No targets found.
Apr 14 14:29:53 user nova-compute[71347]: iSNS:
Apr 14 14:29:53 user nova-compute[71347]: No targets found.
Apr 14 14:29:53 user nova-compute[71347]: STATIC:
Apr 14 14:29:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d
Apr 14 14:29:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32
Apr 14 14:29:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:29:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:29:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:29:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:29:53 user nova-compute[71347]: FIRMWARE:
Apr 14 14:29:53 user nova-compute[71347]: No targets found.
Apr 14 14:29:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:29:53 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:29:53 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0347ce1d-9a5e-447e-a58c-d6693a568689]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a647b963-111a-4bce-ac9a-b6ce42dff863]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:53 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:53 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:53 user nova-compute[71347]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)
Apr 14 14:29:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:29:53 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:29:53 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:29:53 user nova-compute[71347]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d (non-flash)
Apr 14 14:29:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4d9caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d'): ({'sdf'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:29:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Removing single pathed devices sdf {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dd2f97-2bce-40ed-9d7f-68e65ce39fa0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a7624b-e5e7-4340-8586-3e785a701f5e]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flushing IO for device /dev/sdf {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c93ac69-d686-4ad3-8ad2-0455ec1dfcdf]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1482de16-8611-49a7-8335-1bf64dcdc531]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] SCSI volumes sdf have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[931a9f75-5ca0-4910-b088-2e7bb375ce3d]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ff87d1-c164-4278-aaf3-5ce0677affa9]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d, portal: 172.16.0.220,3260]
Apr 14 14:29:54 user nova-compute[71347]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d, portal: 172.16.0.220,3260] successful.
Apr 14 14:29:54 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e8ef61f-fc6b-47dc-99ad-79c2470ef08d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9729ca8b-5fbb-42bc-b14c-1c1480334b2f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] <== disconnect_volume: return (345ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:29:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:29:55 user nova-compute[71347]: DEBUG nova.objects.instance [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'flavor' on Instance uuid fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:29:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1e58eb2a-d397-426a-905c-9e719fc99f3c tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.876s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:29:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:29:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:30:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:04 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:04 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:30:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:06 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:30:08 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:30:08 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7627MB free_disk=26.402145385742188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fc7da5e7-7b87-458f-82b1-055664003a85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:30:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:30:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:30:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:30:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:30:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [{"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:30:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:30:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:30:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:30:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:25 user nova-compute[71347]: INFO nova.compute.manager [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Terminating instance
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.compute.manager [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-unplugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] No waiting events found dispatching network-vif-unplugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-65b536fa-2f6d-45c2-b2d4-6c6b4a07774a req-6ba80923-f14a-4e64-8aa4-843bf8743d6a service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-unplugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:30:25 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Instance destroyed successfully.
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.objects.instance [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lazy-loading 'resources' on Instance uuid c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:24:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1136227517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1136227517',id=22,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC39skeqyy/RTc2E6soubP86qzQn/9pjIW/1tJXv0fmp+gdA0Bxhni7OkdPTKsoLqOCieZ5vJZzWbW7TfycVdcSU7X4yS6qH4uWHDqSZ80Xuf9itLdPoLws4FAivnu+l1A==',key_name='tempest-keypair-428673856',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:28:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8263321b4e34ea08350e97ac2a3a794',ramdisk_id='',reservation_id='r-yy4znehp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1666709251',owner_user_name='tempest-AttachVolumeShelveTestJSON-1666709251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a7a99d9a44334bfeb39f6684853f6844',uuid=c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converting VIF {"id": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "address": "fa:16:3e:ec:6c:a2", "network": {"id": "e0719d7f-e55b-4c63-91f9-8feef7bd3905", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-473771376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8263321b4e34ea08350e97ac2a3a794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72fbb0dc-8b", "ovs_interfaceid": "72fbb0dc-8b93-4cc7-8ddc-0f7853749614", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG os_vif [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72fbb0dc-8b, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:30:25 user nova-compute[71347]: INFO os_vif [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6c:a2,bridge_name='br-int',has_traffic_filtering=True,id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614,network=Network(e0719d7f-e55b-4c63-91f9-8feef7bd3905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72fbb0dc-8b')
Apr 14 14:30:25 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Deleting instance files /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e_del
Apr 14 14:30:25 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Deletion of /opt/stack/data/nova/instances/c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e_del complete
Apr 14 14:30:25 user nova-compute[71347]: INFO nova.compute.manager [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Took 0.77 seconds to destroy the instance on the hypervisor.
Apr 14 14:30:25 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:30:25 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-deleted-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:27 user nova-compute[71347]: INFO nova.compute.manager [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Neutron deleted interface 72fbb0dc-8b93-4cc7-8ddc-0f7853749614; detaching it from the instance and deleting it from the info cache
Apr 14 14:30:27 user nova-compute[71347]: DEBUG nova.network.neutron [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:30:27 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Took 1.57 seconds to deallocate network for instance.
Apr 14 14:30:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-be724c7a-ffb4-4d81-95f0-6c3c214bf8ca req-b7432f07-cb87-4a64-84a6-03917048a7b7 service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Detach interface failed, port_id=72fbb0dc-8b93-4cc7-8ddc-0f7853749614, reason: Instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] Acquiring lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] No waiting events found dispatching network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:30:27 user nova-compute[71347]: WARNING nova.compute.manager [req-95417610-dc99-481e-989d-e5771a41d908 req-b04d4e64-2a19-4142-81d2-ca7e3d9e0e0e service nova] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Received unexpected event network-vif-plugged-72fbb0dc-8b93-4cc7-8ddc-0f7853749614 for instance with vm_state active and task_state deleting.
Apr 14 14:30:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:30:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:27 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Deleted allocations for instance c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e
Apr 14 14:30:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a29495e9-05da-442d-977d-1313fcb9eebb tempest-AttachVolumeShelveTestJSON-1666709251 tempest-AttachVolumeShelveTestJSON-1666709251-project-member] Lock "c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.957s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:30:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:40 user nova-compute[71347]: INFO nova.compute.manager [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Terminating instance
Apr 14 14:30:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482625.6889737, c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:30:40 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] VM Stopped (Lifecycle Event)
Apr 14 14:30:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-81c4b1e2-f055-49d5-91b4-a4bcad947f2c None None] [instance: c2cd1a3c-6a0e-4097-ba88-97a7d5c7270e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received event network-vif-unplugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] No waiting events found dispatching network-vif-unplugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-7731bcd2-5d43-4c67-8a7a-613727100457 req-7d4c1426-bb6b-4a86-9fca-2a296b9260a6 service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received event network-vif-unplugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:30:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Instance destroyed successfully.
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'resources' on Instance uuid 4fa04501-bc13-4309-b3a2-d972e2fc7c93 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-43491806',display_name='tempest-AttachVolumeNegativeTest-server-43491806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-43491806',id=26,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH77xmesvyrmE1nAACucYPHAK4jz+KuavjrQv5Px2cfKULQzmGdyTrtF5BDnN0G67IJwSYDCGCPSiqFhrETT+fyIeq+l5kZcow5VXI+HPlKRgVceDjHUIn5ctKoxERtfA==',key_name='tempest-keypair-1827852531',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:27:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-szl41osq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:27:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=4fa04501-bc13-4309-b3a2-d972e2fc7c93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "address": "fa:16:3e:c8:98:7d", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a9de01b-07", "ovs_interfaceid": "4a9de01b-07a4-4bcf-933f-3d493bae2db1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:98:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a9de01b-07a4-4bcf-933f-3d493bae2db1,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a9de01b-07') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG os_vif [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:98:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a9de01b-07a4-4bcf-933f-3d493bae2db1,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a9de01b-07') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a9de01b-07, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:30:41 user nova-compute[71347]: INFO os_vif [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:98:7d,bridge_name='br-int',has_traffic_filtering=True,id=4a9de01b-07a4-4bcf-933f-3d493bae2db1,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a9de01b-07')
Apr 14 14:30:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Deleting instance files /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93_del
Apr 14 14:30:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Deletion of /opt/stack/data/nova/instances/4fa04501-bc13-4309-b3a2-d972e2fc7c93_del complete
Apr 14 14:30:41 user nova-compute[71347]: INFO nova.compute.manager [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 14:30:41 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:30:41 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:30:42 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:30:42 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Took 0.94 seconds to deallocate network for instance.
Apr 14 14:30:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-2a0089cc-d511-4a09-9d89-1391d1dccbdc req-55d311d5-3d58-46bb-9066-17398fe3c00b service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received event network-vif-deleted-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:42 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:30:42 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:30:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:42 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Deleted allocations for instance 4fa04501-bc13-4309-b3a2-d972e2fc7c93
Apr 14 14:30:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2ec250a0-0971-4eff-b1b3-21022317489c tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.418s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received event network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] Acquiring lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] Lock "4fa04501-bc13-4309-b3a2-d972e2fc7c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] No waiting events found dispatching network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:30:43 user nova-compute[71347]: WARNING nova.compute.manager [req-a4e66d5d-0edd-4db1-ad70-85a9b4cc5731 req-6121dddd-821d-480d-b348-921862c16c0f service nova] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Received unexpected event network-vif-plugged-4a9de01b-07a4-4bcf-933f-3d493bae2db1 for instance with vm_state deleted and task_state None.
Apr 14 14:30:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:46 user nova-compute[71347]: INFO nova.compute.manager [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Terminating instance
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-38fb8013-28d3-46bf-851d-3e55d9c16cc0 req-2ee43b20-1e35-4001-9b45-4cc385e9ff51 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-unplugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:30:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Instance destroyed successfully.
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.objects.instance [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'resources' on Instance uuid a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-178100452',display_name='tempest-ServerActionsTestJSON-server-1012026360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-178100452',id=5,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:28:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-89p8yq98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "address": "fa:16:3e:32:d4:b0", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb1d71a-d0", "ovs_interfaceid": "2eb1d71a-d0d7-473d-9eef-b939fd4b55ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_vif [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eb1d71a-d0, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:30:46 user nova-compute[71347]: INFO os_vif [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:d4:b0,bridge_name='br-int',has_traffic_filtering=True,id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb1d71a-d0')
Apr 14 14:30:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQsUPvbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:30:46 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c1f81f-3de3-4b3a-8016-0de38c206d4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:30:46 user nova-compute[71347]: No targets found.
Apr 14 14:30:46 user nova-compute[71347]: iSNS:
Apr 14 14:30:46 user nova-compute[71347]: No targets found.
Apr 14 14:30:46 user nova-compute[71347]: STATIC:
Apr 14 14:30:46 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32
Apr 14 14:30:46 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:30:46 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:30:46 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:30:46 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:30:46 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:30:46 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12
Apr 14 14:30:46 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:30:46 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:30:46 user nova-compute[71347]: FIRMWARE:
Apr 14 14:30:46 user nova-compute[71347]: No targets found.
Apr 14 14:30:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:30:46 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:30:46 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e72e74b-7906-43b5-a66e-aa4c1300e9a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[089efb47-3303-4c6b-a516-a4b851087920]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:30:46 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:30:46 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:30:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:30:46 user nova-compute[71347]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 (non-flash)
Apr 14 14:30:46 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:30:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4db15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:30:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6979ebb9-4fb4-42d5-846c-b1813536a46c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a64747-4f7e-430d-bb26-ce2c3b0ec2c4]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0906d9c0-130e-42f4-a0da-c1cb2afe506d]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d3604f-99fc-4be4-8828-78a9da76acdc]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d055cddf-3e3e-4153-9c30-c3a3390f6466]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f8bea1-edf8-43ed-9ce4-ae2a83d03814]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260]
Apr 14 14:30:47 user nova-compute[71347]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12, portal: 172.16.0.220,3260] successful.
Apr 14 14:30:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a5bdd54-ac1c-4dcf-a30b-316c15cb9a12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f86dbd6-ff55-42c5-84e5-a7c3aea5e313]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== disconnect_volume: return (340ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:30:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Deleting instance files /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e_del
Apr 14 14:30:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Deletion of /opt/stack/data/nova/instances/a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e_del complete
Apr 14 14:30:47 user nova-compute[71347]: INFO nova.compute.manager [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 14 14:30:47 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:30:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:30:48 user nova-compute[71347]: INFO nova.compute.manager [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] instance snapshotting
Apr 14 14:30:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Beginning live snapshot process
Apr 14 14:30:48 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:30:48 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Took 0.95 seconds to deallocate network for instance.
Apr 14 14:30:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-deleted-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:48 user nova-compute[71347]: INFO nova.compute.manager [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Neutron deleted interface 2eb1d71a-d0d7-473d-9eef-b939fd4b55ef; detaching it from the instance and deleting it from the info cache
Apr 14 14:30:48 user nova-compute[71347]: DEBUG nova.network.neutron [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-87a85805-b0c0-44f5-827e-8df55b56ea1f req-fc8e96e6-1bd5-480b-8425-1e9a07ba6be3 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Detach interface failed, port_id=2eb1d71a-d0d7-473d-9eef-b939fd4b55ef, reason: Instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json -f qcow2 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json -f qcow2 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] Acquiring lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] No waiting events found dispatching network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:30:48 user nova-compute[71347]: WARNING nova.compute.manager [req-10270158-2155-411d-9d54-ac95ae76c282 req-7d987bfd-f11e-4bd8-932d-74df35a23071 service nova] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Received unexpected event network-vif-plugged-2eb1d71a-d0d7-473d-9eef-b939fd4b55ef for instance with vm_state active and task_state deleting.
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.179s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmtcfpxxs/a64b246b0d0540dba418b3220c194bda.delta 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmtcfpxxs/a64b246b0d0540dba418b3220c194bda.delta 1073741824" returned: 0 in 0.053s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 14:30:49 user nova-compute[71347]: INFO nova.compute.manager [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Took 1.05 seconds to detach 1 volumes for instance.
Apr 14 14:30:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:49 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:30:49 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:30:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:49 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Deleted allocations for instance a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e
Apr 14 14:30:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:30:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aee64396-3b29-4e2a-93d4-ed34f6e050b1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.930s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:30:50 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 14:30:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-changed-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing instance network info cache due to event network-changed-017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:30:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] Acquiring lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:30:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] Acquired lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:30:50 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing network info cache for port 017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:30:50 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:30:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmtcfpxxs/a64b246b0d0540dba418b3220c194bda.delta /opt/stack/data/nova/instances/snapshots/tmpmtcfpxxs/a64b246b0d0540dba418b3220c194bda {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmtcfpxxs/a64b246b0d0540dba418b3220c194bda.delta /opt/stack/data/nova/instances/snapshots/tmpmtcfpxxs/a64b246b0d0540dba418b3220c194bda" returned: 0 in 0.341s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:50 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Snapshot extracted, beginning image upload
Apr 14 14:30:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updated VIF entry in instance network info cache for port 017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating instance_info_cache with network_info: [{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0a0a952-4a14-42c2-a5f9-a9df7610f9d5 req-079efc08-b2da-42ca-8ea3-d1c43696df7e service nova] Releasing lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-changed-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing instance network info cache due to event network-changed-017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] Acquiring lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] Acquired lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Refreshing network info cache for port 017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:52 user nova-compute[71347]: INFO nova.compute.manager [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Detaching volume 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32
Apr 14 14:30:52 user nova-compute[71347]: INFO nova.virt.block_device [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Attempting to driver detach volume 5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 from mountpoint /dev/vdb
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Attempting to detach device vdb from instance 5e419ecb-c1e3-4713-a190-62a7f220d01a from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:30:52 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:30:52 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:30:52 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:30:52 user nova-compute[71347]:   <serial>5f94c09b-5ac0-4fcb-81f1-996b7e7aed32</serial>
Apr 14 14:30:52 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:30:52 user nova-compute[71347]: </disk>
Apr 14 14:30:52 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:30:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully detached device vdb from instance 5e419ecb-c1e3-4713-a190-62a7f220d01a from the persistent domain config.
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e419ecb-c1e3-4713-a190-62a7f220d01a from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:30:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:30:52 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:30:52 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:30:52 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:30:52 user nova-compute[71347]:   <serial>5f94c09b-5ac0-4fcb-81f1-996b7e7aed32</serial>
Apr 14 14:30:52 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:30:52 user nova-compute[71347]: </disk>
Apr 14 14:30:52 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG nova.network.neutron [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updated VIF entry in instance network info cache for port 017c2389-4552-4847-9195-84fe74787c99. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG nova.network.neutron [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating instance_info_cache with network_info: [{"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec09a44d-b495-41c8-9245-52b869b0a85f req-4163ce99-d13f-4e5f-b374-3dcc8e646ec3 service nova] Releasing lock "refresh_cache-5e419ecb-c1e3-4713-a190-62a7f220d01a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482653.385265, 5e419ecb-c1e3-4713-a190-62a7f220d01a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:30:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully detached device vdb from instance 5e419ecb-c1e3-4713-a190-62a7f220d01a from the live domain config.
Apr 14 14:30:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvjTsyKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:30:53 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6fb91a-9a05-4ca5-a96c-df5ac563790f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:30:53 user nova-compute[71347]: No targets found.
Apr 14 14:30:53 user nova-compute[71347]: iSNS:
Apr 14 14:30:53 user nova-compute[71347]: No targets found.
Apr 14 14:30:53 user nova-compute[71347]: STATIC:
Apr 14 14:30:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32
Apr 14 14:30:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:30:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:30:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:30:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:30:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:30:53 user nova-compute[71347]: FIRMWARE:
Apr 14 14:30:53 user nova-compute[71347]: No targets found.
Apr 14 14:30:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:30:53 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:30:53 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf701e-ec05-4f27-b946-0f0b8f01cc9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660f2c7-1c1f-40af-bf0b-189ea6968fcb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:30:53 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:30:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:30:53 user nova-compute[71347]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 (non-flash)
Apr 14 14:30:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ff8115510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Snapshot image upload complete
Apr 14 14:30:53 user nova-compute[71347]: INFO nova.compute.manager [None req-63d9eb40-c5ed-42ed-95bd-e0c551dbb1ef tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Took 5.47 seconds to snapshot the instance on the hypervisor.
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b311b4bf-f59f-4a6d-a517-cb5eb1afbd94]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1b3a8e-5d21-472c-bce1-85e2d9304e50]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[27307f35-0b85-4eb1-a627-111c822940d6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[997414fb-5dd3-4090-8eed-6ead098041f6]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[91136814-fea0-46f5-a773-732cada317b6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae09552-ace0-4ead-b213-6ac46510df36]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32, portal: 172.16.0.220,3260]
Apr 14 14:30:53 user nova-compute[71347]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32, portal: 172.16.0.220,3260] successful.
Apr 14 14:30:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f94c09b-5ac0-4fcb-81f1-996b7e7aed32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1473ea-a9e6-42dc-8d5d-884d9a303153]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] <== disconnect_volume: return (324ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:30:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:30:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'flavor' on Instance uuid 5e419ecb-c1e3-4713-a190-62a7f220d01a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:30:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c5aab216-26c1-4bf3-bdcc-b675c0e467de tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:56 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482641.35754, 4fa04501-bc13-4309-b3a2-d972e2fc7c93 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:30:56 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] VM Stopped (Lifecycle Event)
Apr 14 14:30:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-8d2b38a6-d935-425d-aaad-0328b26580e8 None None] [instance: 4fa04501-bc13-4309-b3a2-d972e2fc7c93] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:30:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:30:59 user nova-compute[71347]: INFO nova.compute.claims [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Claim successful on node user
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.network.neutron [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:30:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.policy [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5bccb6643e84c53ab7f1301bdf0cb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e043301622414bb492b48f0c6366a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:30:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Creating image(s)
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "/opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "/opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "/opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "de308132653c08068e5f64538977a4289d4391c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:30:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "de308132653c08068e5f64538977a4289d4391c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG nova.virt.images [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 25145ae9-9290-432b-9bc8-6eb80cf99145 was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8.part /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG nova.network.neutron [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Successfully created port: 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8.part /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8.converted" returned: 0 in 0.222s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "de308132653c08068e5f64538977a4289d4391c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.126s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8 --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "de308132653c08068e5f64538977a4289d4391c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "de308132653c08068e5f64538977a4289d4391c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8 --force-share --output=json" returned: 0 in 0.128s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8,backing_fmt=raw /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8,backing_fmt=raw /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk 1073741824" returned: 0 in 0.052s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "de308132653c08068e5f64538977a4289d4391c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8 --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8 --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.objects.instance [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'migration_context' on Instance uuid 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Ensure instance console log exists: /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.network.neutron [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Successfully updated port: 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquired lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.network.neutron [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-changed-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Refreshing instance network info cache due to event network-changed-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] Acquiring lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.network.neutron [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482646.8429356, a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:01 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] VM Stopped (Lifecycle Event)
Apr 14 14:31:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ad1d1ed3-8916-4a6a-89eb-d3c0452fffb4 None None] [instance: a9bcf0ae-9f0b-4b0b-bbb2-001d7777417e] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.network.neutron [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updating instance_info_cache with network_info: [{"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Releasing lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Instance network_info: |[{"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] Acquired lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.network.neutron [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Refreshing network info cache for port 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Start _get_guest_xml network_info=[{"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4b26f3b74a5c96039f478065901d062f',container_format='bare',created_at=2023-04-14T14:30:48Z,direct_url=<?>,disk_format='qcow2',id=25145ae9-9290-432b-9bc8-6eb80cf99145,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-570292702',owner='51e043301622414bb492b48f0c6366a2',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T14:30:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '25145ae9-9290-432b-9bc8-6eb80cf99145'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:31:02 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:02 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4b26f3b74a5c96039f478065901d062f',container_format='bare',created_at=2023-04-14T14:30:48Z,direct_url=<?>,disk_format='qcow2',id=25145ae9-9290-432b-9bc8-6eb80cf99145,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-570292702',owner='51e043301622414bb492b48f0c6366a2',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T14:30:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2070944659',display_name='tempest-TestStampPattern-server-2070944659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2070944659',id=28,image_ref='25145ae9-9290-432b-9bc8-6eb80cf99145',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVd5d8f1BuBRppDw9HXKQyu3/1iOI3YZuUkyUZmTb2VBMBhBMIyRKqpoaUA5/dZnFrRfFPyALC45bswJQWvC/+I/l7V8YK8+DU0/n020XSkmcHMDH6Po4guzWitPY9ppA==',key_name='tempest-TestStampPattern-594781561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e043301622414bb492b48f0c6366a2',ramdisk_id='',reservation_id='r-koa0w0je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fc7da5e7-7b87-458f-82b1-055664003a85',image_min_disk='1',image_min_ram='0',image_owner_id='51e043301622414bb492b48f0c6366a2',image_owner_project_name='tempest-TestStampPattern-523457803',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-523457803-project-member',image_user_id='b5bccb6643e84c53ab7f1301bdf0cb97',network_allocated='True',owner_project_name='tempest-TestStampPattern-523457803',owner_user_name='tempest-TestStampPattern-523457803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:31:00Z,user_data=None,user_id='b5bccb6643e84c53ab7f1301bdf0cb97',uuid=95a6c9af-12a8-440a-b27c-701fc24da3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converting VIF {"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:b4:6b,bridge_name='br-int',has_traffic_filtering=True,id=8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb4ea6e-fe') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'pci_devices' on Instance uuid 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:31:02 user nova-compute[71347]:   <uuid>95a6c9af-12a8-440a-b27c-701fc24da3f7</uuid>
Apr 14 14:31:02 user nova-compute[71347]:   <name>instance-0000001c</name>
Apr 14 14:31:02 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:31:02 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:31:02 user nova-compute[71347]:   <metadata>
Apr 14 14:31:02 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:31:02 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:31:02 user nova-compute[71347]:       <nova:name>tempest-TestStampPattern-server-2070944659</nova:name>
Apr 14 14:31:02 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:31:02</nova:creationTime>
Apr 14 14:31:02 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:31:02 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:31:02 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:31:02 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:31:02 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:31:02 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:31:02 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:31:02 user nova-compute[71347]:       <nova:owner>
Apr 14 14:31:02 user nova-compute[71347]:         <nova:user uuid="b5bccb6643e84c53ab7f1301bdf0cb97">tempest-TestStampPattern-523457803-project-member</nova:user>
Apr 14 14:31:02 user nova-compute[71347]:         <nova:project uuid="51e043301622414bb492b48f0c6366a2">tempest-TestStampPattern-523457803</nova:project>
Apr 14 14:31:02 user nova-compute[71347]:       </nova:owner>
Apr 14 14:31:02 user nova-compute[71347]:       <nova:root type="image" uuid="25145ae9-9290-432b-9bc8-6eb80cf99145"/>
Apr 14 14:31:02 user nova-compute[71347]:       <nova:ports>
Apr 14 14:31:02 user nova-compute[71347]:         <nova:port uuid="8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b">
Apr 14 14:31:02 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 14:31:02 user nova-compute[71347]:         </nova:port>
Apr 14 14:31:02 user nova-compute[71347]:       </nova:ports>
Apr 14 14:31:02 user nova-compute[71347]:     </nova:instance>
Apr 14 14:31:02 user nova-compute[71347]:   </metadata>
Apr 14 14:31:02 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:31:02 user nova-compute[71347]:     <system>
Apr 14 14:31:02 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:31:02 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:31:02 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:31:02 user nova-compute[71347]:       <entry name="serial">95a6c9af-12a8-440a-b27c-701fc24da3f7</entry>
Apr 14 14:31:02 user nova-compute[71347]:       <entry name="uuid">95a6c9af-12a8-440a-b27c-701fc24da3f7</entry>
Apr 14 14:31:02 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:31:02 user nova-compute[71347]:     </system>
Apr 14 14:31:02 user nova-compute[71347]:   </sysinfo>
Apr 14 14:31:02 user nova-compute[71347]:   <os>
Apr 14 14:31:02 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:31:02 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:31:02 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:31:02 user nova-compute[71347]:   </os>
Apr 14 14:31:02 user nova-compute[71347]:   <features>
Apr 14 14:31:02 user nova-compute[71347]:     <acpi/>
Apr 14 14:31:02 user nova-compute[71347]:     <apic/>
Apr 14 14:31:02 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:31:02 user nova-compute[71347]:   </features>
Apr 14 14:31:02 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:31:02 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:31:02 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:31:02 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:31:02 user nova-compute[71347]:   </clock>
Apr 14 14:31:02 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:31:02 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:31:02 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:31:02 user nova-compute[71347]:   </cpu>
Apr 14 14:31:02 user nova-compute[71347]:   <devices>
Apr 14 14:31:02 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:31:02 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:31:02 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk"/>
Apr 14 14:31:02 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:31:02 user nova-compute[71347]:     </disk>
Apr 14 14:31:02 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:31:02 user nova-compute[71347]:       <mac address="fa:16:3e:36:b4:6b"/>
Apr 14 14:31:02 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:31:02 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:31:02 user nova-compute[71347]:       <target dev="tap8eb4ea6e-fe"/>
Apr 14 14:31:02 user nova-compute[71347]:     </interface>
Apr 14 14:31:02 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:31:02 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/console.log" append="off"/>
Apr 14 14:31:02 user nova-compute[71347]:     </serial>
Apr 14 14:31:02 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:31:02 user nova-compute[71347]:     <video>
Apr 14 14:31:02 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:31:02 user nova-compute[71347]:     </video>
Apr 14 14:31:02 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:31:02 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:31:02 user nova-compute[71347]:     </rng>
Apr 14 14:31:02 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:31:02 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:31:02 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:31:02 user nova-compute[71347]:     </memballoon>
Apr 14 14:31:02 user nova-compute[71347]:   </devices>
Apr 14 14:31:02 user nova-compute[71347]: </domain>
Apr 14 14:31:02 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2070944659',display_name='tempest-TestStampPattern-server-2070944659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2070944659',id=28,image_ref='25145ae9-9290-432b-9bc8-6eb80cf99145',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVd5d8f1BuBRppDw9HXKQyu3/1iOI3YZuUkyUZmTb2VBMBhBMIyRKqpoaUA5/dZnFrRfFPyALC45bswJQWvC/+I/l7V8YK8+DU0/n020XSkmcHMDH6Po4guzWitPY9ppA==',key_name='tempest-TestStampPattern-594781561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e043301622414bb492b48f0c6366a2',ramdisk_id='',reservation_id='r-koa0w0je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fc7da5e7-7b87-458f-82b1-055664003a85',image_min_disk='1',image_min_ram='0',image_owner_id='51e043301622414bb492b48f0c6366a2',image_owner_project_name='tempest-TestStampPattern-523457803',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-523457803-project-member',image_user_id='b5bccb6643e84c53ab7f1301bdf0cb97',network_allocated='True',owner_project_name='tempest-TestStampPattern-523457803',owner_user_name='tempest-TestStampPattern-523457803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:31:00Z,user_data=None,user_id='b5bccb6643e84c53ab7f1301bdf0cb97',uuid=95a6c9af-12a8-440a-b27c-701fc24da3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converting VIF {"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:b4:6b,bridge_name='br-int',has_traffic_filtering=True,id=8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb4ea6e-fe') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG os_vif [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b4:6b,bridge_name='br-int',has_traffic_filtering=True,id=8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb4ea6e-fe') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eb4ea6e-fe, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8eb4ea6e-fe, col_values=(('external_ids', {'iface-id': '8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:b4:6b', 'vm-uuid': '95a6c9af-12a8-440a-b27c-701fc24da3f7'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:02 user nova-compute[71347]: INFO os_vif [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:b4:6b,bridge_name='br-int',has_traffic_filtering=True,id=8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb4ea6e-fe')
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No VIF found with MAC fa:16:3e:36:b4:6b, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.network.neutron [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updated VIF entry in instance network info cache for port 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.network.neutron [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updating instance_info_cache with network_info: [{"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0ece322c-71e4-4da5-90a5-cf8d25f778d2 req-f781b3ab-b616-4384-be89-71f73c2ae0ad service nova] Releasing lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] No waiting events found dispatching network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:03 user nova-compute[71347]: WARNING nova.compute.manager [req-3df4e8be-9be5-4732-a903-8a348ebfb408 req-b0a834a9-d21b-47bd-be50-bddcec24d401 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received unexpected event network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance with vm_state building and task_state spawning.
Apr 14 14:31:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:31:04 user nova-compute[71347]: INFO nova.compute.claims [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Claim successful on node user
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.network.neutron [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:31:04 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:31:04 user nova-compute[71347]: INFO nova.virt.block_device [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Booting with volume 1eb54abc-e5f8-4871-b539-2002d1b2a221 at /dev/vda
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.policy [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc2d448f2dfc45498252bab608df3446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8137fbeb0b0546eb9fd19b76bb8b6b7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG os_brick.utils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2354681c-d823-49cc-b287-7fd6dcfffe34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[018531f2-644a-4a10-96ae-04f89d4de9b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3b924d-fd56-473a-90f5-861d9878eb46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cc525e-6d8c-4047-8680-765687fc2a52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:31:04 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:31:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[53657b3d-482a-4517-971c-1ce76c176614]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG os_brick.utils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:31:04 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating existing volume attachment record: ae8d8db9-bbbf-4cb3-89a5-5df155a8cf0c {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:31:05 user nova-compute[71347]: DEBUG nova.network.neutron [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Successfully created port: 1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:31:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] No waiting events found dispatching network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:05 user nova-compute[71347]: WARNING nova.compute.manager [req-d8a62690-c7da-4c76-bf1e-9000f1c434a1 req-a53c811d-76c7-44b5-932e-063fdb4b6e02 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received unexpected event network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance with vm_state building and task_state spawning.
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482666.056895, 95a6c9af-12a8-440a-b27c-701fc24da3f7 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:06 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] VM Resumed (Lifecycle Event)
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:31:06 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Instance spawned successfully.
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:31:06 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482666.0583065, 95a6c9af-12a8-440a-b27c-701fc24da3f7 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:06 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] VM Started (Lifecycle Event)
Apr 14 14:31:06 user nova-compute[71347]: INFO nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Took 6.30 seconds to spawn the instance on the hypervisor.
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:31:06 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:31:06 user nova-compute[71347]: INFO nova.compute.manager [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Took 7.02 seconds to build instance.
Apr 14 14:31:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-816f4346-128c-4dbb-85b9-a3f195c238b4 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.133s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.network.neutron [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Successfully updated port: 1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquired lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.network.neutron [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing instance network info cache due to event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] Acquiring lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.network.neutron [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Skipping network cache update for instance because it is Building. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:31:06 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG nova.network.neutron [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Releasing lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance network_info: |[{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] Acquired lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG nova.network.neutron [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updating instance_info_cache with network_info: [{"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-30643f90-4347-4b1e-b1ca-57e69e716fb4" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG nova.network.neutron [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updated VIF entry in instance network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG nova.network.neutron [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-95587fe9-2f20-42a7-82ca-a807fed4fd89 req-0e6433c2-79dd-472b-b23b-4a32c681df73 service nova] Releasing lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:31:09 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Creating image(s)
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Ensure instance console log exists: /opt/stack/data/nova/instances/ca57f876-a86b-4a47-b941-ea2fd63f1298/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Start _get_guest_xml network_info=[{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UstmfrpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca57f876-a86b-4a47-b941-ea2fd63f1298', 'attached_at': '', 'detached_at': '', 'volume_id': '1eb54abc-e5f8-4871-b539-2002d1b2a221', 'serial': '1eb54abc-e5f8-4871-b539-2002d1b2a221'}, 'attachment_id': 'ae8d8db9-bbbf-4cb3-89a5-5df155a8cf0c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:09 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:09 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UstmfrpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:31:09 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:31:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:31:09 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:31:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:31:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:31:09 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:31:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3855fd99-6d07-4824-b410-d3eebce6f63f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:31:10 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1247e21f-2d16-4afc-aee0-a3fcb30d8d44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221] added
Apr 14 14:31:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e886bf02-6bda-45a4-8820-935b7724768a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f170c97-01d9-4f5f-9055-63a018cc1a04]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UstmfrpS {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UstmfrpS" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[480cb47a-6eb7-4eca-94fa-160b571aba15]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UstmfrpS'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd7124-bb34-4d16-88f3-b9ba8a8e68f9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80369f-6759-46f0-9cc4-1da79fc72818]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:31:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:31:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54067a3-9ddd-4697-b866-769137e69b17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260]
Apr 14 14:31:10 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260] successful.
Apr 14 14:31:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab49af6-ef33-485f-a40d-ce63b531cb4a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e4f42-68ca-4a2f-a69b-7c39411119f9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:31:10 user nova-compute[71347]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:31:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:31:10 user nova-compute[71347]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:31:10 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e7237-ce43-4376-a09c-632a06bcca7d]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:10 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:10 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7914MB free_disk=26.34191131591797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3faeeb1-a50c-474b-b694-98c4d70435d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 5e419ecb-c1e3-4713-a190-62a7f220d01a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fc7da5e7-7b87-458f-82b1-055664003a85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UstmfrpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23766366363646165', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766366363646165', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-755157756',display_name='tempest-TestShelveInstance-server-755157756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-755157756',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKJoKJ0C1gwmcl9WN0481R6riIzUurMmeNe4HFPJSFtnAOso9CjS53uyvJdMv1WXI2soZXZFuXATdLz+HY8o19OMrATVnZBHoN6oICfZYn1/7aJe4UeWOor3ZtbYKjF6A==',key_name='tempest-TestShelveInstance-790180658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8137fbeb0b0546eb9fd19b76bb8b6b7a',ramdisk_id='',reservation_id='r-wz0by5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1144252643',owner_user_name='tempest-TestShelveInstance-1144252643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:31:05Z,user_data=None,user_id='bc2d448f2dfc45498252bab608df3446',uuid=ca57f876-a86b-4a47-b941-ea2fd63f1298,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converting VIF {"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.objects.instance [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'pci_devices' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:31:11 user nova-compute[71347]:   <uuid>ca57f876-a86b-4a47-b941-ea2fd63f1298</uuid>
Apr 14 14:31:11 user nova-compute[71347]:   <name>instance-0000001d</name>
Apr 14 14:31:11 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:31:11 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:31:11 user nova-compute[71347]:   <metadata>
Apr 14 14:31:11 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:31:11 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:31:11 user nova-compute[71347]:       <nova:name>tempest-TestShelveInstance-server-755157756</nova:name>
Apr 14 14:31:11 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:31:09</nova:creationTime>
Apr 14 14:31:11 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:31:11 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:31:11 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:31:11 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:31:11 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:31:11 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:31:11 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:31:11 user nova-compute[71347]:       <nova:owner>
Apr 14 14:31:11 user nova-compute[71347]:         <nova:user uuid="bc2d448f2dfc45498252bab608df3446">tempest-TestShelveInstance-1144252643-project-member</nova:user>
Apr 14 14:31:11 user nova-compute[71347]:         <nova:project uuid="8137fbeb0b0546eb9fd19b76bb8b6b7a">tempest-TestShelveInstance-1144252643</nova:project>
Apr 14 14:31:11 user nova-compute[71347]:       </nova:owner>
Apr 14 14:31:11 user nova-compute[71347]:       <nova:ports>
Apr 14 14:31:11 user nova-compute[71347]:         <nova:port uuid="1219695c-8de1-4b6b-a558-b7713d98a9a9">
Apr 14 14:31:11 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 14:31:11 user nova-compute[71347]:         </nova:port>
Apr 14 14:31:11 user nova-compute[71347]:       </nova:ports>
Apr 14 14:31:11 user nova-compute[71347]:     </nova:instance>
Apr 14 14:31:11 user nova-compute[71347]:   </metadata>
Apr 14 14:31:11 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:31:11 user nova-compute[71347]:     <system>
Apr 14 14:31:11 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:31:11 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:31:11 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:31:11 user nova-compute[71347]:       <entry name="serial">ca57f876-a86b-4a47-b941-ea2fd63f1298</entry>
Apr 14 14:31:11 user nova-compute[71347]:       <entry name="uuid">ca57f876-a86b-4a47-b941-ea2fd63f1298</entry>
Apr 14 14:31:11 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:31:11 user nova-compute[71347]:     </system>
Apr 14 14:31:11 user nova-compute[71347]:   </sysinfo>
Apr 14 14:31:11 user nova-compute[71347]:   <os>
Apr 14 14:31:11 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:31:11 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:31:11 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:31:11 user nova-compute[71347]:   </os>
Apr 14 14:31:11 user nova-compute[71347]:   <features>
Apr 14 14:31:11 user nova-compute[71347]:     <acpi/>
Apr 14 14:31:11 user nova-compute[71347]:     <apic/>
Apr 14 14:31:11 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:31:11 user nova-compute[71347]:   </features>
Apr 14 14:31:11 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:31:11 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:31:11 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:31:11 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:31:11 user nova-compute[71347]:   </clock>
Apr 14 14:31:11 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:31:11 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:31:11 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:31:11 user nova-compute[71347]:   </cpu>
Apr 14 14:31:11 user nova-compute[71347]:   <devices>
Apr 14 14:31:11 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:31:11 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:31:11 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:31:11 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:31:11 user nova-compute[71347]:       <serial>1eb54abc-e5f8-4871-b539-2002d1b2a221</serial>
Apr 14 14:31:11 user nova-compute[71347]:     </disk>
Apr 14 14:31:11 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:31:11 user nova-compute[71347]:       <mac address="fa:16:3e:a6:b5:7d"/>
Apr 14 14:31:11 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:31:11 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:31:11 user nova-compute[71347]:       <target dev="tap1219695c-8d"/>
Apr 14 14:31:11 user nova-compute[71347]:     </interface>
Apr 14 14:31:11 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:31:11 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/ca57f876-a86b-4a47-b941-ea2fd63f1298/console.log" append="off"/>
Apr 14 14:31:11 user nova-compute[71347]:     </serial>
Apr 14 14:31:11 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:31:11 user nova-compute[71347]:     <video>
Apr 14 14:31:11 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:31:11 user nova-compute[71347]:     </video>
Apr 14 14:31:11 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:31:11 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:31:11 user nova-compute[71347]:     </rng>
Apr 14 14:31:11 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:31:11 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:31:11 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:31:11 user nova-compute[71347]:     </memballoon>
Apr 14 14:31:11 user nova-compute[71347]:   </devices>
Apr 14 14:31:11 user nova-compute[71347]: </domain>
Apr 14 14:31:11 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-755157756',display_name='tempest-TestShelveInstance-server-755157756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-755157756',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKJoKJ0C1gwmcl9WN0481R6riIzUurMmeNe4HFPJSFtnAOso9CjS53uyvJdMv1WXI2soZXZFuXATdLz+HY8o19OMrATVnZBHoN6oICfZYn1/7aJe4UeWOor3ZtbYKjF6A==',key_name='tempest-TestShelveInstance-790180658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8137fbeb0b0546eb9fd19b76bb8b6b7a',ramdisk_id='',reservation_id='r-wz0by5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1144252643',owner_user_name='tempest-TestShelveInstance-1144252643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:31:05Z,user_data=None,user_id='bc2d448f2dfc45498252bab608df3446',uuid=ca57f876-a86b-4a47-b941-ea2fd63f1298,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converting VIF {"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG os_vif [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1219695c-8d, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1219695c-8d, col_values=(('external_ids', {'iface-id': '1219695c-8de1-4b6b-a558-b7713d98a9a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:b5:7d', 'vm-uuid': 'ca57f876-a86b-4a47-b941-ea2fd63f1298'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:11 user nova-compute[71347]: INFO os_vif [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d')
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:31:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] No VIF found with MAC fa:16:3e:a6:b5:7d, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:31:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:31:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] No waiting events found dispatching network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:13 user nova-compute[71347]: WARNING nova.compute.manager [req-946d7483-f82c-4ad5-879d-58768c1b7d92 req-9037c0e6-ba9c-4a67-b038-0afe78ab998a service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received unexpected event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance with vm_state building and task_state spawning.
Apr 14 14:31:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:14 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482674.967226, ca57f876-a86b-4a47-b941-ea2fd63f1298 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:14 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] VM Resumed (Lifecycle Event)
Apr 14 14:31:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:31:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:31:14 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance spawned successfully.
Apr 14 14:31:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:31:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:15 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482674.9689393, ca57f876-a86b-4a47-b941-ea2fd63f1298 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:15 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] VM Started (Lifecycle Event)
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:31:15 user nova-compute[71347]: INFO nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Took 5.26 seconds to spawn the instance on the hypervisor.
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:15 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:31:15 user nova-compute[71347]: INFO nova.compute.manager [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Took 11.16 seconds to build instance.
Apr 14 14:31:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-74cd5161-8f7a-44c1-8c6d-4084666b1532 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.259s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] No waiting events found dispatching network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:15 user nova-compute[71347]: WARNING nova.compute.manager [req-e092ca60-b2e3-47eb-ae10-cd0ba99218a0 req-8b90c899-8f8c-48a5-899a-311204721dff service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received unexpected event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance with vm_state active and task_state None.
Apr 14 14:31:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-changed-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Refreshing instance network info cache due to event network-changed-72e0d4cc-2ecb-438e-97d0-faf165fef862. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] Acquiring lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] Acquired lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.network.neutron [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Refreshing network info cache for port 72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:19 user nova-compute[71347]: INFO nova.compute.manager [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Detaching volume 6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:31:19 user nova-compute[71347]: INFO nova.virt.block_device [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Attempting to driver detach volume 6b260ade-e92c-4dc6-8df7-54de936c6877 from mountpoint /dev/vdb
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Attempting to detach device vdb from instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:31:19 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:31:19 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:31:19 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:31:19 user nova-compute[71347]:   <serial>6b260ade-e92c-4dc6-8df7-54de936c6877</serial>
Apr 14 14:31:19 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:31:19 user nova-compute[71347]: </disk>
Apr 14 14:31:19 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:31:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Successfully detached device vdb from instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b from the persistent domain config.
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:31:19 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:31:19 user nova-compute[71347]:   <source dev="/dev/sde"/>
Apr 14 14:31:19 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:31:19 user nova-compute[71347]:   <serial>6b260ade-e92c-4dc6-8df7-54de936c6877</serial>
Apr 14 14:31:19 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:31:19 user nova-compute[71347]: </disk>
Apr 14 14:31:19 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.network.neutron [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updated VIF entry in instance network info cache for port 72e0d4cc-2ecb-438e-97d0-faf165fef862. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG nova.network.neutron [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating instance_info_cache with network_info: [{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4857bddd-a968-4715-b1cd-e27e2326d07c req-4d1a7cfa-8675-41b9-94ef-31bed48ebadf service nova] Releasing lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482680.1120892, fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:31:20 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Successfully detached device vdb from instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b from the live domain config.
Apr 14 14:31:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgtIruVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:31:20 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff543ff-f7c3-4978-b531-900239f0941a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:31:20 user nova-compute[71347]: No targets found.
Apr 14 14:31:20 user nova-compute[71347]: iSNS:
Apr 14 14:31:20 user nova-compute[71347]: No targets found.
Apr 14 14:31:20 user nova-compute[71347]: STATIC:
Apr 14 14:31:20 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877
Apr 14 14:31:20 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:31:20 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:31:20 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221
Apr 14 14:31:20 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:31:20 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:31:20 user nova-compute[71347]: FIRMWARE:
Apr 14 14:31:20 user nova-compute[71347]: No targets found.
Apr 14 14:31:20 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:31:20 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:31:20 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fae968-26b2-4565-a3c8-b0853d816c47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b5cf2e-39ba-4db3-8fdc-65c79d1726d3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:31:20 user nova-compute[71347]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:31:20 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 (non-flash)
Apr 14 14:31:20 user nova-compute[71347]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:31:20 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4f22050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[79caa834-36d2-49e1-838f-5f43b4bde0c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0708281-a56e-42d7-882a-65564f76618b]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fa63aa-6101-4cc5-972e-0c8bc24c7802]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[26879f50-4004-49a9-9b5c-c69e527aa744]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cca96c-666c-43e7-b5a5-72bed9693161]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[90796e54-7daf-44f5-9f74-e8f0da4ad3d0]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877, portal: 172.16.0.220,3260]
Apr 14 14:31:20 user nova-compute[71347]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877, portal: 172.16.0.220,3260] successful.
Apr 14 14:31:20 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b260ade-e92c-4dc6-8df7-54de936c6877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ac393-1a9e-4058-9a17-36e77f2680a0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] <== disconnect_volume: return (355ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:31:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-changed-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Refreshing instance network info cache due to event network-changed-72e0d4cc-2ecb-438e-97d0-faf165fef862. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] Acquiring lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] Acquired lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG nova.network.neutron [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Refreshing network info cache for port 72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG nova.objects.instance [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'flavor' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-aa5fa4c1-d6b0-4755-a93b-b3d6a3adb8bb tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.851s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG nova.network.neutron [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updated VIF entry in instance network info cache for port 72e0d4cc-2ecb-438e-97d0-faf165fef862. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG nova.network.neutron [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating instance_info_cache with network_info: [{"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-212c5d96-6233-46cd-bbae-ba536f7087d5 req-7ba17954-80d5-48a6-a0f9-7d7d852e7f10 service nova] Releasing lock "refresh_cache-fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:31:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:31:34 user nova-compute[71347]: INFO nova.compute.claims [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Claim successful on node user
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.network.neutron [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:31:35 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.policy [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5db83169bedc4520b5e2a2b595362ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df56fb88b961464496757a358fd15169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:31:35 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Creating image(s)
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "/opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "/opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "/opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.162s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk 1073741824" returned: 0 in 0.051s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.194s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:31:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Cannot resize image /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG nova.objects.instance [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'migration_context' on Instance uuid a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Ensure instance console log exists: /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG nova.network.neutron [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Successfully created port: f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:31:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Successfully updated port: f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquired lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received event network-changed-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Refreshing instance network info cache due to event network-changed-f7107c4c-5255-44d3-bb66-e89affe36f75. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] Acquiring lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:37 user nova-compute[71347]: INFO nova.compute.manager [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Terminating instance
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Updating instance_info_cache with network_info: [{"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Releasing lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Instance network_info: |[{"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] Acquired lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.network.neutron [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Refreshing network info cache for port f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Start _get_guest_xml network_info=[{"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:31:37 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:37 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:31:37 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1099630364',display_name='tempest-AttachVolumeNegativeTest-server-1099630364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1099630364',id=30,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhFalSigEmM/qdeFp13swzmTqKkKdefyD8LEgpHWpeke9RVOd9xVI6DSJsz57YRHcM+YiKIpcv+9Xi/T4Xj+WbcZjFvIwe3H0tvDuHt0gBs4Mt8I3sT+uJbbG8uU5tag==',key_name='tempest-keypair-1386274115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-qflqtwrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=a30fcbc6-d8b3-42cd-8bac-fb425bb5a680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:22:33,bridge_name='br-int',has_traffic_filtering=True,id=f7107c4c-5255-44d3-bb66-e89affe36f75,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7107c4c-52') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'pci_devices' on Instance uuid a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:31:38 user nova-compute[71347]:   <uuid>a30fcbc6-d8b3-42cd-8bac-fb425bb5a680</uuid>
Apr 14 14:31:38 user nova-compute[71347]:   <name>instance-0000001e</name>
Apr 14 14:31:38 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:31:38 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:31:38 user nova-compute[71347]:   <metadata>
Apr 14 14:31:38 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:31:38 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:31:38 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1099630364</nova:name>
Apr 14 14:31:38 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:31:37</nova:creationTime>
Apr 14 14:31:38 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:31:38 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:31:38 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:31:38 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:31:38 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:31:38 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:31:38 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:31:38 user nova-compute[71347]:       <nova:owner>
Apr 14 14:31:38 user nova-compute[71347]:         <nova:user uuid="5db83169bedc4520b5e2a2b595362ec1">tempest-AttachVolumeNegativeTest-134968716-project-member</nova:user>
Apr 14 14:31:38 user nova-compute[71347]:         <nova:project uuid="df56fb88b961464496757a358fd15169">tempest-AttachVolumeNegativeTest-134968716</nova:project>
Apr 14 14:31:38 user nova-compute[71347]:       </nova:owner>
Apr 14 14:31:38 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:31:38 user nova-compute[71347]:       <nova:ports>
Apr 14 14:31:38 user nova-compute[71347]:         <nova:port uuid="f7107c4c-5255-44d3-bb66-e89affe36f75">
Apr 14 14:31:38 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 14:31:38 user nova-compute[71347]:         </nova:port>
Apr 14 14:31:38 user nova-compute[71347]:       </nova:ports>
Apr 14 14:31:38 user nova-compute[71347]:     </nova:instance>
Apr 14 14:31:38 user nova-compute[71347]:   </metadata>
Apr 14 14:31:38 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:31:38 user nova-compute[71347]:     <system>
Apr 14 14:31:38 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:31:38 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:31:38 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:31:38 user nova-compute[71347]:       <entry name="serial">a30fcbc6-d8b3-42cd-8bac-fb425bb5a680</entry>
Apr 14 14:31:38 user nova-compute[71347]:       <entry name="uuid">a30fcbc6-d8b3-42cd-8bac-fb425bb5a680</entry>
Apr 14 14:31:38 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:31:38 user nova-compute[71347]:     </system>
Apr 14 14:31:38 user nova-compute[71347]:   </sysinfo>
Apr 14 14:31:38 user nova-compute[71347]:   <os>
Apr 14 14:31:38 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:31:38 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:31:38 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:31:38 user nova-compute[71347]:   </os>
Apr 14 14:31:38 user nova-compute[71347]:   <features>
Apr 14 14:31:38 user nova-compute[71347]:     <acpi/>
Apr 14 14:31:38 user nova-compute[71347]:     <apic/>
Apr 14 14:31:38 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:31:38 user nova-compute[71347]:   </features>
Apr 14 14:31:38 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:31:38 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:31:38 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:31:38 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:31:38 user nova-compute[71347]:   </clock>
Apr 14 14:31:38 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:31:38 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:31:38 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:31:38 user nova-compute[71347]:   </cpu>
Apr 14 14:31:38 user nova-compute[71347]:   <devices>
Apr 14 14:31:38 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:31:38 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:31:38 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk"/>
Apr 14 14:31:38 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:31:38 user nova-compute[71347]:     </disk>
Apr 14 14:31:38 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:31:38 user nova-compute[71347]:       <mac address="fa:16:3e:ab:22:33"/>
Apr 14 14:31:38 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:31:38 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:31:38 user nova-compute[71347]:       <target dev="tapf7107c4c-52"/>
Apr 14 14:31:38 user nova-compute[71347]:     </interface>
Apr 14 14:31:38 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:31:38 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/console.log" append="off"/>
Apr 14 14:31:38 user nova-compute[71347]:     </serial>
Apr 14 14:31:38 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:31:38 user nova-compute[71347]:     <video>
Apr 14 14:31:38 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:31:38 user nova-compute[71347]:     </video>
Apr 14 14:31:38 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:31:38 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:31:38 user nova-compute[71347]:     </rng>
Apr 14 14:31:38 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:31:38 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:31:38 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:31:38 user nova-compute[71347]:     </memballoon>
Apr 14 14:31:38 user nova-compute[71347]:   </devices>
Apr 14 14:31:38 user nova-compute[71347]: </domain>
Apr 14 14:31:38 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1099630364',display_name='tempest-AttachVolumeNegativeTest-server-1099630364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1099630364',id=30,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhFalSigEmM/qdeFp13swzmTqKkKdefyD8LEgpHWpeke9RVOd9xVI6DSJsz57YRHcM+YiKIpcv+9Xi/T4Xj+WbcZjFvIwe3H0tvDuHt0gBs4Mt8I3sT+uJbbG8uU5tag==',key_name='tempest-keypair-1386274115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-qflqtwrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:31:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=a30fcbc6-d8b3-42cd-8bac-fb425bb5a680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:22:33,bridge_name='br-int',has_traffic_filtering=True,id=f7107c4c-5255-44d3-bb66-e89affe36f75,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7107c4c-52') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG os_vif [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:22:33,bridge_name='br-int',has_traffic_filtering=True,id=f7107c4c-5255-44d3-bb66-e89affe36f75,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7107c4c-52') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7107c4c-52, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7107c4c-52, col_values=(('external_ids', {'iface-id': 'f7107c4c-5255-44d3-bb66-e89affe36f75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:22:33', 'vm-uuid': 'a30fcbc6-d8b3-42cd-8bac-fb425bb5a680'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:38 user nova-compute[71347]: INFO os_vif [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:22:33,bridge_name='br-int',has_traffic_filtering=True,id=f7107c4c-5255-44d3-bb66-e89affe36f75,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7107c4c-52')
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No VIF found with MAC fa:16:3e:ab:22:33, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "48dc94a3-6933-475b-8803-828acc9d6577" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "48dc94a3-6933-475b-8803-828acc9d6577" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:31:39 user nova-compute[71347]: INFO nova.compute.claims [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Claim successful on node user
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Updated VIF entry in instance network info cache for port f7107c4c-5255-44d3-bb66-e89affe36f75. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Updating instance_info_cache with network_info: [{"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ef9f6f15-c280-43ea-8b4e-f8ecaa1f46db req-3708b0aa-5501-4346-a211-39d30717a64e service nova] Releasing lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-unplugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Acquiring lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] No waiting events found dispatching network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:39 user nova-compute[71347]: WARNING nova.compute.manager [req-b930eca7-0695-4016-8f34-c438a264d5e2 req-22438690-5bbb-44fe-a039-2871f961b76b service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received unexpected event network-vif-plugged-693b3793-ec24-4c90-ba05-73d5e4eaa30f for instance with vm_state active and task_state deleting.
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:31:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Instance destroyed successfully.
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.objects.instance [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'resources' on Instance uuid a3faeeb1-a50c-474b-b694-98c4d70435d5 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-398425278',display_name='tempest-AttachVolumeTestJSON-server-398425278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-398425278',id=19,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBADq3EuyWHc+YgOYQ7rVsh9Br+MUN5Pnf8I7h1nUzN7F0WjBiEayTStDt1WeF8Jz+8yltTmMyDpGYpMvVwQu+i1XKW5wTN8W+o/93TY8satFrOhUv3J1+rgybmoVXA2Wg==',key_name='tempest-keypair-1819910287',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-343k7a40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=a3faeeb1-a50c-474b-b694-98c4d70435d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "address": "fa:16:3e:39:a0:32", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap693b3793-ec", "ovs_interfaceid": "693b3793-ec24-4c90-ba05-73d5e4eaa30f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG os_vif [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap693b3793-ec, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:39 user nova-compute[71347]: INFO os_vif [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a0:32,bridge_name='br-int',has_traffic_filtering=True,id=693b3793-ec24-4c90-ba05-73d5e4eaa30f,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap693b3793-ec')
Apr 14 14:31:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Deleting instance files /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5_del
Apr 14 14:31:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Deletion of /opt/stack/data/nova/instances/a3faeeb1-a50c-474b-b694-98c4d70435d5_del complete
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.network.neutron [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:31:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:31:39 user nova-compute[71347]: INFO nova.compute.manager [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Took 1.75 seconds to destroy the instance on the hypervisor.
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:31:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Creating image(s)
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "/opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "/opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "/opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG nova.policy [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.172s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received event network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] No waiting events found dispatching network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:40 user nova-compute[71347]: WARNING nova.compute.manager [req-38f9ec73-fe0f-41d5-9f27-17e5df88a795 req-275aa05e-f619-43cc-b327-11ef50bf29ab service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received unexpected event network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 for instance with vm_state building and task_state spawning.
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.197s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk 1073741824" returned: 0 in 0.057s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.160s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Cannot resize image /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG nova.objects.instance [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'migration_context' on Instance uuid 48dc94a3-6933-475b-8803-828acc9d6577 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Ensure instance console log exists: /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG nova.network.neutron [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Successfully created port: a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:31:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:41 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Took 1.50 seconds to deallocate network for instance.
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-7b2dd7e4-4808-45a2-abc1-38c384d0c494 req-b9685dc5-74d1-46e6-acd8-0f9090aa0376 service nova] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Received event network-vif-deleted-693b3793-ec24-4c90-ba05-73d5e4eaa30f {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Successfully updated port: a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-changed-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Refreshing instance network info cache due to event network-changed-a7f26438-6282-4bdb-a730-cddb218c10ce. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] Acquiring lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:31:41 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Deleted allocations for instance a3faeeb1-a50c-474b-b694-98c4d70435d5
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1d41a8eb-c09b-4e94-8e30-c5449073de04 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "a3faeeb1-a50c-474b-b694-98c4d70435d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.777s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.neutron [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updating instance_info_cache with network_info: [{"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Instance network_info: |[{"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] Acquired lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.neutron [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Refreshing network info cache for port a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Start _get_guest_xml network_info=[{"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:31:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1361343797',display_name='tempest-ServerActionsTestJSON-server-1361343797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1361343797',id=31,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-6qxnv59y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=48dc94a3-6933-475b-8803-828acc9d6577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:05:97,bridge_name='br-int',has_traffic_filtering=True,id=a7f26438-6282-4bdb-a730-cddb218c10ce,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f26438-62') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_devices' on Instance uuid 48dc94a3-6933-475b-8803-828acc9d6577 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:31:41 user nova-compute[71347]:   <uuid>48dc94a3-6933-475b-8803-828acc9d6577</uuid>
Apr 14 14:31:41 user nova-compute[71347]:   <name>instance-0000001f</name>
Apr 14 14:31:41 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:31:41 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:31:41 user nova-compute[71347]:   <metadata>
Apr 14 14:31:41 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:31:41 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:31:41 user nova-compute[71347]:       <nova:name>tempest-ServerActionsTestJSON-server-1361343797</nova:name>
Apr 14 14:31:41 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:31:41</nova:creationTime>
Apr 14 14:31:41 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:31:41 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:31:41 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:31:41 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:31:41 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:31:41 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:31:41 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:31:41 user nova-compute[71347]:       <nova:owner>
Apr 14 14:31:41 user nova-compute[71347]:         <nova:user uuid="797d2d1bff8e4b26afe7856e4c3877cf">tempest-ServerActionsTestJSON-932644409-project-member</nova:user>
Apr 14 14:31:41 user nova-compute[71347]:         <nova:project uuid="3b087f26a80045f3844873220a67a4e4">tempest-ServerActionsTestJSON-932644409</nova:project>
Apr 14 14:31:41 user nova-compute[71347]:       </nova:owner>
Apr 14 14:31:41 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:31:41 user nova-compute[71347]:       <nova:ports>
Apr 14 14:31:41 user nova-compute[71347]:         <nova:port uuid="a7f26438-6282-4bdb-a730-cddb218c10ce">
Apr 14 14:31:41 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 14:31:41 user nova-compute[71347]:         </nova:port>
Apr 14 14:31:41 user nova-compute[71347]:       </nova:ports>
Apr 14 14:31:41 user nova-compute[71347]:     </nova:instance>
Apr 14 14:31:41 user nova-compute[71347]:   </metadata>
Apr 14 14:31:41 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:31:41 user nova-compute[71347]:     <system>
Apr 14 14:31:41 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:31:41 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:31:41 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:31:41 user nova-compute[71347]:       <entry name="serial">48dc94a3-6933-475b-8803-828acc9d6577</entry>
Apr 14 14:31:41 user nova-compute[71347]:       <entry name="uuid">48dc94a3-6933-475b-8803-828acc9d6577</entry>
Apr 14 14:31:41 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:31:41 user nova-compute[71347]:     </system>
Apr 14 14:31:41 user nova-compute[71347]:   </sysinfo>
Apr 14 14:31:41 user nova-compute[71347]:   <os>
Apr 14 14:31:41 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:31:41 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:31:41 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:31:41 user nova-compute[71347]:   </os>
Apr 14 14:31:41 user nova-compute[71347]:   <features>
Apr 14 14:31:41 user nova-compute[71347]:     <acpi/>
Apr 14 14:31:41 user nova-compute[71347]:     <apic/>
Apr 14 14:31:41 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:31:41 user nova-compute[71347]:   </features>
Apr 14 14:31:41 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:31:41 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:31:41 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:31:41 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:31:41 user nova-compute[71347]:   </clock>
Apr 14 14:31:41 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:31:41 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:31:41 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:31:41 user nova-compute[71347]:   </cpu>
Apr 14 14:31:41 user nova-compute[71347]:   <devices>
Apr 14 14:31:41 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:31:41 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:31:41 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk"/>
Apr 14 14:31:41 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:31:41 user nova-compute[71347]:     </disk>
Apr 14 14:31:41 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:31:41 user nova-compute[71347]:       <mac address="fa:16:3e:88:05:97"/>
Apr 14 14:31:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:31:41 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:31:41 user nova-compute[71347]:       <target dev="tapa7f26438-62"/>
Apr 14 14:31:41 user nova-compute[71347]:     </interface>
Apr 14 14:31:41 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:31:41 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/console.log" append="off"/>
Apr 14 14:31:41 user nova-compute[71347]:     </serial>
Apr 14 14:31:41 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:31:41 user nova-compute[71347]:     <video>
Apr 14 14:31:41 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:31:41 user nova-compute[71347]:     </video>
Apr 14 14:31:41 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:31:41 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:31:41 user nova-compute[71347]:     </rng>
Apr 14 14:31:41 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:31:41 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:31:41 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:31:41 user nova-compute[71347]:     </memballoon>
Apr 14 14:31:41 user nova-compute[71347]:   </devices>
Apr 14 14:31:41 user nova-compute[71347]: </domain>
Apr 14 14:31:41 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1361343797',display_name='tempest-ServerActionsTestJSON-server-1361343797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1361343797',id=31,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-6qxnv59y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=48dc94a3-6933-475b-8803-828acc9d6577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:05:97,bridge_name='br-int',has_traffic_filtering=True,id=a7f26438-6282-4bdb-a730-cddb218c10ce,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f26438-62') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG os_vif [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:05:97,bridge_name='br-int',has_traffic_filtering=True,id=a7f26438-6282-4bdb-a730-cddb218c10ce,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f26438-62') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7f26438-62, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7f26438-62, col_values=(('external_ids', {'iface-id': 'a7f26438-6282-4bdb-a730-cddb218c10ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:05:97', 'vm-uuid': '48dc94a3-6933-475b-8803-828acc9d6577'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:31:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:41 user nova-compute[71347]: INFO os_vif [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:05:97,bridge_name='br-int',has_traffic_filtering=True,id=a7f26438-6282-4bdb-a730-cddb218c10ce,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f26438-62')
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No VIF found with MAC fa:16:3e:88:05:97, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received event network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] No waiting events found dispatching network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:42 user nova-compute[71347]: WARNING nova.compute.manager [req-700d8652-9f8d-4c7e-8088-3b7510f44783 req-2a31349b-66d2-4fad-9275-eef2f6a182f8 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received unexpected event network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 for instance with vm_state building and task_state spawning.
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482702.2973206, a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] VM Resumed (Lifecycle Event)
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:31:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Instance spawned successfully.
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:31:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482702.3001008, a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] VM Started (Lifecycle Event)
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:31:42 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.network.neutron [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updated VIF entry in instance network info cache for port a7f26438-6282-4bdb-a730-cddb218c10ce. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.network.neutron [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updating instance_info_cache with network_info: [{"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:42 user nova-compute[71347]: INFO nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Took 7.10 seconds to spawn the instance on the hypervisor.
Apr 14 14:31:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-264f6328-ea07-4fe3-9826-80b71cfa3b36 req-28372895-edf5-4cd8-a899-3cc3db53fbdf service nova] Releasing lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:31:42 user nova-compute[71347]: INFO nova.compute.manager [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Took 8.01 seconds to build instance.
Apr 14 14:31:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-040e1d9d-cf75-4553-892d-2810f64dce54 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.158s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] Acquiring lock "48dc94a3-6933-475b-8803-828acc9d6577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] No waiting events found dispatching network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:43 user nova-compute[71347]: WARNING nova.compute.manager [req-089a42a7-6a9b-48bf-bed9-c6590675995d req-fb127d22-344f-4ae8-a075-6daf4c24f949 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received unexpected event network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce for instance with vm_state building and task_state spawning.
Apr 14 14:31:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] Acquiring lock "48dc94a3-6933-475b-8803-828acc9d6577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] No waiting events found dispatching network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:45 user nova-compute[71347]: WARNING nova.compute.manager [req-3f34e7ce-5cd9-462a-853b-0ee4166fcdc3 req-f350b666-b7ad-48ea-8376-2fd8d2a3cc03 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received unexpected event network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce for instance with vm_state building and task_state spawning.
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482705.8089812, 48dc94a3-6933-475b-8803-828acc9d6577 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:45 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] VM Resumed (Lifecycle Event)
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:31:45 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Instance spawned successfully.
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:31:45 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482705.8100724, 48dc94a3-6933-475b-8803-828acc9d6577 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:45 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] VM Started (Lifecycle Event)
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:31:45 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:31:45 user nova-compute[71347]: INFO nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Took 6.22 seconds to spawn the instance on the hypervisor.
Apr 14 14:31:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:46 user nova-compute[71347]: INFO nova.compute.manager [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Took 7.00 seconds to build instance.
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-44e527fc-e0af-4264-bcd7-e0ea4533ab33 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "48dc94a3-6933-475b-8803-828acc9d6577" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.092s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:46 user nova-compute[71347]: INFO nova.compute.manager [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Terminating instance
Apr 14 14:31:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-unplugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] No waiting events found dispatching network-vif-unplugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-4bf04336-0b2d-448f-9eb2-0d6e8e3227eb req-f8f50634-91f8-4f75-b6f1-5fcef0a15f8c service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-unplugged-017c2389-4552-4847-9195-84fe74787c99 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:31:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Instance destroyed successfully.
Apr 14 14:31:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lazy-loading 'resources' on Instance uuid 5e419ecb-c1e3-4713-a190-62a7f220d01a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1608636042',display_name='tempest-TestMinimumBasicScenario-server-1608636042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1608636042',id=24,image_ref='9de2d251-ab11-4790-9d8b-f377d8e365bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLPNmyz5FZJ3JAXf567ogWCKZDDVaqr9sdsziyTaoW8c91s8+u4CUBY6blg8NMdt+y5NCYJ1EOsl2swnOrdXNwIidTwhVARRGFOvEPgRirEEdPwZP062lK/mCMIA4xsg==',key_name='tempest-TestMinimumBasicScenario-349171501',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1df398dd4f844286b41ee4948001013a',ramdisk_id='',reservation_id='r-y4b0kty0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9de2d251-ab11-4790-9d8b-f377d8e365bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248098662',owner_user_name='tempest-TestMinimumBasicScenario-248098662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:29:06Z,user_data=None,user_id='19dad04c158549c39991ea05fca2531d',uuid=5e419ecb-c1e3-4713-a190-62a7f220d01a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converting VIF {"id": "017c2389-4552-4847-9195-84fe74787c99", "address": "fa:16:3e:58:e9:07", "network": {"id": "3e6dc6fc-92d7-4a9c-a3d4-6314555e6096", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1927053501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1df398dd4f844286b41ee4948001013a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap017c2389-45", "ovs_interfaceid": "017c2389-4552-4847-9195-84fe74787c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:e9:07,bridge_name='br-int',has_traffic_filtering=True,id=017c2389-4552-4847-9195-84fe74787c99,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017c2389-45') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG os_vif [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:e9:07,bridge_name='br-int',has_traffic_filtering=True,id=017c2389-4552-4847-9195-84fe74787c99,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017c2389-45') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap017c2389-45, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:47 user nova-compute[71347]: INFO os_vif [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:e9:07,bridge_name='br-int',has_traffic_filtering=True,id=017c2389-4552-4847-9195-84fe74787c99,network=Network(3e6dc6fc-92d7-4a9c-a3d4-6314555e6096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap017c2389-45')
Apr 14 14:31:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Deleting instance files /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a_del
Apr 14 14:31:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Deletion of /opt/stack/data/nova/instances/5e419ecb-c1e3-4713-a190-62a7f220d01a_del complete
Apr 14 14:31:47 user nova-compute[71347]: INFO nova.compute.manager [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 14:31:47 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:31:47 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:31:48 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Took 0.70 seconds to deallocate network for instance.
Apr 14 14:31:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:48 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Deleted allocations for instance 5e419ecb-c1e3-4713-a190-62a7f220d01a
Apr 14 14:31:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f41c6885-2837-4d52-ba61-1c0a59688255 tempest-TestMinimumBasicScenario-248098662 tempest-TestMinimumBasicScenario-248098662-project-member] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Acquiring lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] Lock "5e419ecb-c1e3-4713-a190-62a7f220d01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:31:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] No waiting events found dispatching network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:31:48 user nova-compute[71347]: WARNING nova.compute.manager [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received unexpected event network-vif-plugged-017c2389-4552-4847-9195-84fe74787c99 for instance with vm_state deleted and task_state None.
Apr 14 14:31:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-866de26b-04b8-4cc7-b1ef-e6bf5feb434e req-482f8a72-e8eb-4217-a6e1-365ebb124fe6 service nova] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Received event network-vif-deleted-017c2389-4552-4847-9195-84fe74787c99 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:31:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:54 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482699.4995222, a3faeeb1-a50c-474b-b694-98c4d70435d5 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:31:54 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] VM Stopped (Lifecycle Event)
Apr 14 14:31:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b3e6576e-01ef-4c65-9912-b9d969bb9a3f None None] [instance: a3faeeb1-a50c-474b-b694-98c4d70435d5] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:31:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:31:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:00 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:02 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482707.3535852, 5e419ecb-c1e3-4713-a190-62a7f220d01a => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:32:02 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] VM Stopped (Lifecycle Event)
Apr 14 14:32:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5d8caeb1-6cf6-401d-8e3c-d7f513e59936 None None] [instance: 5e419ecb-c1e3-4713-a190-62a7f220d01a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:32:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:04 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:04 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:32:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:06 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:06 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:07 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:32:09 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:32:09 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:32:09 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=7750MB free_disk=26.326492309570312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:09 user nova-compute[71347]: INFO nova.compute.manager [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Terminating instance
Apr 14 14:32:09 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fc7da5e7-7b87-458f-82b1-055664003a85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-d304952a-452a-404d-b1ba-9824978c43f0 req-47cf145f-3f82-4990-a3ad-70efc425bb2b service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-unplugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:10 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Instance destroyed successfully.
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.objects.instance [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'resources' on Instance uuid fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056227109',display_name='tempest-ServerRescueNegativeTestJSON-server-2056227109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056227109',id=23,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPuRsvBsGHusqtnaC8Oj9LBXgh3nY9LkQ3OL84XGLcTKFxNlys1/HBw5E8x0pZTchYk3yzjHgyDVXSLOySeUV4vk6BzjfyRxiyugq/K16fvubSEZS4xq2p9ZGyf7T/74w==',key_name='tempest-keypair-1178292711',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:27:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-d3hey8gz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:29:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "address": "fa:16:3e:2b:9a:e1", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e0d4cc-2e", "ovs_interfaceid": "72e0d4cc-2ecb-438e-97d0-faf165fef862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9a:e1,bridge_name='br-int',has_traffic_filtering=True,id=72e0d4cc-2ecb-438e-97d0-faf165fef862,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e0d4cc-2e') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG os_vif [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9a:e1,bridge_name='br-int',has_traffic_filtering=True,id=72e0d4cc-2ecb-438e-97d0-faf165fef862,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e0d4cc-2e') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72e0d4cc-2e, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:32:10 user nova-compute[71347]: INFO os_vif [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:9a:e1,bridge_name='br-int',has_traffic_filtering=True,id=72e0d4cc-2ecb-438e-97d0-faf165fef862,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e0d4cc-2e')
Apr 14 14:32:10 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Deleting instance files /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b_del
Apr 14 14:32:10 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Deletion of /opt/stack/data/nova/instances/fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b_del complete
Apr 14 14:32:10 user nova-compute[71347]: INFO nova.compute.manager [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 14:32:10 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:32:10 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:32:11 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:32:11 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Took 0.85 seconds to deallocate network for instance.
Apr 14 14:32:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:11 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:32:11 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:12 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Deleted allocations for instance fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7e3d8125-d065-4921-8e4f-2766a33df339 tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Acquiring lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] Lock "fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] No waiting events found dispatching network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:32:12 user nova-compute[71347]: WARNING nova.compute.manager [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received unexpected event network-vif-plugged-72e0d4cc-2ecb-438e-97d0-faf165fef862 for instance with vm_state deleted and task_state None.
Apr 14 14:32:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-662c6f5f-c612-4ab5-95d0-0bd2400b8875 req-2bc2f47e-a946-473f-8b54-30682eec3ba4 service nova] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Received event network-vif-deleted-72e0d4cc-2ecb-438e-97d0-faf165fef862 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:32:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:32:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updating instance_info_cache with network_info: [{"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:32:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-7c7956b5-905e-4a1a-b657-fe3aa5018258" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:32:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:32:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:32:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:32:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:25 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482730.7318313, fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:32:25 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] VM Stopped (Lifecycle Event)
Apr 14 14:32:25 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2fa17075-5086-45f4-b52e-395098a2458c None None] [instance: fefb223e-f7d2-4ddd-ab5e-f7db6d1a538b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:32:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:32:32 user nova-compute[71347]: INFO nova.compute.claims [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Claim successful on node user
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:32:32 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:32:32 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Creating image(s)
Apr 14 14:32:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "/opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "/opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "/opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:32 user nova-compute[71347]: DEBUG nova.policy [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '303cb0475ae74f328ee503d1e9d1f652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd9adda27714cf5b55203d8d76de05a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk 1073741824" returned: 0 in 0.054s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Cannot resize image /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'migration_context' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Ensure instance console log exists: /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:33 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Successfully created port: 14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Successfully updated port: 14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquired lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received event network-changed-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Refreshing instance network info cache due to event network-changed-14f10c1f-44c6-4ddb-9dcd-16205410ce60. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] Acquiring lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.neutron [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Updating instance_info_cache with network_info: [{"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Releasing lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Instance network_info: |[{"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] Acquired lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.neutron [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Refreshing network info cache for port 14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Start _get_guest_xml network_info=[{"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:32:34 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:32:34 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-53779625',display_name='tempest-AttachVolumeTestJSON-server-53779625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-53779625',id=32,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6nxE5S1wXirRhC6sEEE9KneN1kwn9K9fmRcCO+E3aGgJS7fOW4IODElILe/Gx+GrA+9S/8eA0xwx1qi2r/F+/PatQ9TQz4wa3zRf8GGvnMpfgt6aeLXG9WeRnJTDpeAg==',key_name='tempest-keypair-279292969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-wk09jshl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=cba499ef-3621-4516-875f-492eef042874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:57:4b,bridge_name='br-int',has_traffic_filtering=True,id=14f10c1f-44c6-4ddb-9dcd-16205410ce60,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f10c1f-44') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'pci_devices' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:32:34 user nova-compute[71347]:   <uuid>cba499ef-3621-4516-875f-492eef042874</uuid>
Apr 14 14:32:34 user nova-compute[71347]:   <name>instance-00000020</name>
Apr 14 14:32:34 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:32:34 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:32:34 user nova-compute[71347]:   <metadata>
Apr 14 14:32:34 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:32:34 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:32:34 user nova-compute[71347]:       <nova:name>tempest-AttachVolumeTestJSON-server-53779625</nova:name>
Apr 14 14:32:34 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:32:34</nova:creationTime>
Apr 14 14:32:34 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:32:34 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:32:34 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:32:34 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:32:34 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:32:34 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:32:34 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:32:34 user nova-compute[71347]:       <nova:owner>
Apr 14 14:32:34 user nova-compute[71347]:         <nova:user uuid="303cb0475ae74f328ee503d1e9d1f652">tempest-AttachVolumeTestJSON-1787222284-project-member</nova:user>
Apr 14 14:32:34 user nova-compute[71347]:         <nova:project uuid="6dd9adda27714cf5b55203d8d76de05a">tempest-AttachVolumeTestJSON-1787222284</nova:project>
Apr 14 14:32:34 user nova-compute[71347]:       </nova:owner>
Apr 14 14:32:34 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:32:34 user nova-compute[71347]:       <nova:ports>
Apr 14 14:32:34 user nova-compute[71347]:         <nova:port uuid="14f10c1f-44c6-4ddb-9dcd-16205410ce60">
Apr 14 14:32:34 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 14:32:34 user nova-compute[71347]:         </nova:port>
Apr 14 14:32:34 user nova-compute[71347]:       </nova:ports>
Apr 14 14:32:34 user nova-compute[71347]:     </nova:instance>
Apr 14 14:32:34 user nova-compute[71347]:   </metadata>
Apr 14 14:32:34 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:32:34 user nova-compute[71347]:     <system>
Apr 14 14:32:34 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:32:34 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:32:34 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:32:34 user nova-compute[71347]:       <entry name="serial">cba499ef-3621-4516-875f-492eef042874</entry>
Apr 14 14:32:34 user nova-compute[71347]:       <entry name="uuid">cba499ef-3621-4516-875f-492eef042874</entry>
Apr 14 14:32:34 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:32:34 user nova-compute[71347]:     </system>
Apr 14 14:32:34 user nova-compute[71347]:   </sysinfo>
Apr 14 14:32:34 user nova-compute[71347]:   <os>
Apr 14 14:32:34 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:32:34 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:32:34 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:32:34 user nova-compute[71347]:   </os>
Apr 14 14:32:34 user nova-compute[71347]:   <features>
Apr 14 14:32:34 user nova-compute[71347]:     <acpi/>
Apr 14 14:32:34 user nova-compute[71347]:     <apic/>
Apr 14 14:32:34 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:32:34 user nova-compute[71347]:   </features>
Apr 14 14:32:34 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:32:34 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:32:34 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:32:34 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:32:34 user nova-compute[71347]:   </clock>
Apr 14 14:32:34 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:32:34 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:32:34 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:32:34 user nova-compute[71347]:   </cpu>
Apr 14 14:32:34 user nova-compute[71347]:   <devices>
Apr 14 14:32:34 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:32:34 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:32:34 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk"/>
Apr 14 14:32:34 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:32:34 user nova-compute[71347]:     </disk>
Apr 14 14:32:34 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:32:34 user nova-compute[71347]:       <mac address="fa:16:3e:8e:57:4b"/>
Apr 14 14:32:34 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:32:34 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:32:34 user nova-compute[71347]:       <target dev="tap14f10c1f-44"/>
Apr 14 14:32:34 user nova-compute[71347]:     </interface>
Apr 14 14:32:34 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:32:34 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/console.log" append="off"/>
Apr 14 14:32:34 user nova-compute[71347]:     </serial>
Apr 14 14:32:34 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:32:34 user nova-compute[71347]:     <video>
Apr 14 14:32:34 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:32:34 user nova-compute[71347]:     </video>
Apr 14 14:32:34 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:32:34 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:32:34 user nova-compute[71347]:     </rng>
Apr 14 14:32:34 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:32:34 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:32:34 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:32:34 user nova-compute[71347]:     </memballoon>
Apr 14 14:32:34 user nova-compute[71347]:   </devices>
Apr 14 14:32:34 user nova-compute[71347]: </domain>
Apr 14 14:32:34 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-53779625',display_name='tempest-AttachVolumeTestJSON-server-53779625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-53779625',id=32,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6nxE5S1wXirRhC6sEEE9KneN1kwn9K9fmRcCO+E3aGgJS7fOW4IODElILe/Gx+GrA+9S/8eA0xwx1qi2r/F+/PatQ9TQz4wa3zRf8GGvnMpfgt6aeLXG9WeRnJTDpeAg==',key_name='tempest-keypair-279292969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-wk09jshl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=cba499ef-3621-4516-875f-492eef042874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:57:4b,bridge_name='br-int',has_traffic_filtering=True,id=14f10c1f-44c6-4ddb-9dcd-16205410ce60,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f10c1f-44') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG os_vif [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:57:4b,bridge_name='br-int',has_traffic_filtering=True,id=14f10c1f-44c6-4ddb-9dcd-16205410ce60,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f10c1f-44') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14f10c1f-44, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14f10c1f-44, col_values=(('external_ids', {'iface-id': '14f10c1f-44c6-4ddb-9dcd-16205410ce60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:57:4b', 'vm-uuid': 'cba499ef-3621-4516-875f-492eef042874'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:34 user nova-compute[71347]: INFO os_vif [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:57:4b,bridge_name='br-int',has_traffic_filtering=True,id=14f10c1f-44c6-4ddb-9dcd-16205410ce60,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f10c1f-44')
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:32:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No VIF found with MAC fa:16:3e:8e:57:4b, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:32:35 user nova-compute[71347]: DEBUG nova.network.neutron [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Updated VIF entry in instance network info cache for port 14f10c1f-44c6-4ddb-9dcd-16205410ce60. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:32:35 user nova-compute[71347]: DEBUG nova.network.neutron [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Updating instance_info_cache with network_info: [{"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:32:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-70e14e23-eb60-44bd-9d70-a06fba853fc9 req-758b1901-083b-4d86-a943-2033e74d1ff5 service nova] Releasing lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:32:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received event network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] Acquiring lock "cba499ef-3621-4516-875f-492eef042874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] Lock "cba499ef-3621-4516-875f-492eef042874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] Lock "cba499ef-3621-4516-875f-492eef042874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] No waiting events found dispatching network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:32:37 user nova-compute[71347]: WARNING nova.compute.manager [req-c37cd23e-436b-4810-ae55-e2873aa247ac req-7a86a016-9034-488d-9fa0-41fc704d7911 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received unexpected event network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance with vm_state building and task_state spawning.
Apr 14 14:32:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482758.9598305, cba499ef-3621-4516-875f-492eef042874 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:32:38 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: cba499ef-3621-4516-875f-492eef042874] VM Resumed (Lifecycle Event)
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:32:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: cba499ef-3621-4516-875f-492eef042874] Instance spawned successfully.
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: cba499ef-3621-4516-875f-492eef042874] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: cba499ef-3621-4516-875f-492eef042874] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:32:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:32:39 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: cba499ef-3621-4516-875f-492eef042874] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:32:39 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482758.9614758, cba499ef-3621-4516-875f-492eef042874 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:32:39 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: cba499ef-3621-4516-875f-492eef042874] VM Started (Lifecycle Event)
Apr 14 14:32:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: cba499ef-3621-4516-875f-492eef042874] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:32:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: cba499ef-3621-4516-875f-492eef042874] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:32:39 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: cba499ef-3621-4516-875f-492eef042874] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:32:39 user nova-compute[71347]: INFO nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Took 6.09 seconds to spawn the instance on the hypervisor.
Apr 14 14:32:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:32:39 user nova-compute[71347]: INFO nova.compute.manager [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Took 6.77 seconds to build instance.
Apr 14 14:32:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e5a26283-cc7f-4d9b-9329-9e1a42d95405 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.884s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received event network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] Acquiring lock "cba499ef-3621-4516-875f-492eef042874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] Lock "cba499ef-3621-4516-875f-492eef042874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] Lock "cba499ef-3621-4516-875f-492eef042874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] No waiting events found dispatching network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:32:39 user nova-compute[71347]: WARNING nova.compute.manager [req-70476bb3-6690-4898-8e27-101a2ba6955b req-a175c351-5b42-4237-9ec5-9358df63d325 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received unexpected event network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance with vm_state active and task_state None.
Apr 14 14:32:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:32:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:32:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:32:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:32:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-changed-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Refreshing instance network info cache due to event network-changed-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] Acquiring lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] Acquired lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Refreshing network info cache for port 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG nova.objects.instance [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'flavor' on Instance uuid 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:51 user nova-compute[71347]: INFO nova.compute.manager [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Attaching volume 4669eb74-f961-4f6a-91c0-a9a14285ba7c to /dev/vdb
Apr 14 14:32:51 user nova-compute[71347]: DEBUG os_brick.utils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ab1b60-93a3-41d3-993e-58fe98bbd83d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ca75e7-3735-46a6-b3e7-a314d46b932e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf0338-9184-4409-8409-f8f725ea62be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffff7a8-76e3-4c9b-90c8-14f3bb534ae5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updated VIF entry in instance network info cache for port 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updating instance_info_cache with network_info: [{"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5d86951b-f223-4c02-a975-21edc53fae50 req-1e18c191-9c84-48cc-bdff-c3387f800d13 service nova] Releasing lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:32:51 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:32:51 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c013215b-e7fe-4491-a70c-c0f0316f672e]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG os_brick.utils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:32:51 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updating existing volume attachment record: 42b1b41e-d916-45e2-97bc-ebbd2df6013a {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:32:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing instance network info cache due to event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] Acquiring lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] Acquired lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:56 user nova-compute[71347]: INFO nova.compute.manager [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Shelve offloading
Apr 14 14:32:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updated VIF entry in instance network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a5e9eaf3-87b1-4757-bc91-c7e49d539f76 req-b5dd6f01-bcc2-421c-b328-de67a589a5b9 service nova] Releasing lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dabenPEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:32:56 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:32:56 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:32:56 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a89ee6a-495f-462a-9495-b528b903aec9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:32:56 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5046d4-da74-409c-81e8-ac1123ab9264]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c] added
Apr 14 14:32:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30c035d-aa62-4709-b740-cdd90a1d3c7e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-unplugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] No waiting events found dispatching network-vif-unplugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:32:56 user nova-compute[71347]: WARNING nova.compute.manager [req-536f14bd-86b4-4387-a0e0-93cab9d89cce req-18964b08-0906-45c0-8739-037228799bf0 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received unexpected event network-vif-unplugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance with vm_state active and task_state shelving.
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfb3efe-9174-4a49-aaa8-791a9d250306]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dabenPEw {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dabenPEw" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b22e943-a890-4082-a75d-c9ba76f4de5c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dabenPEw'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb4263a-7808-4ec8-bacf-aa0bf8364a78]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3972baa1-4ccb-46bd-b233-b0d944b03464]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:32:56 user nova-compute[71347]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)
Apr 14 14:32:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:32:56 user nova-compute[71347]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)
Apr 14 14:32:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf10777e-d267-4497-8f42-c4db61a7581c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c, portal: 172.16.0.220,3260]
Apr 14 14:32:56 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c, portal: 172.16.0.220,3260] successful.
Apr 14 14:32:56 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed3115-7991-4cef-83b8-19e67314c0b3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:56 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe091f8-09ae-428a-be19-5bc67b391931]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:32:57 user nova-compute[71347]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)
Apr 14 14:32:57 user nova-compute[71347]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)
Apr 14 14:32:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:32:57 user nova-compute[71347]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)
Apr 14 14:32:57 user nova-compute[71347]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)
Apr 14 14:32:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97ac853-8e10-4013-a6c6-3f7b96b76664]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dabenPEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:32:57 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance destroyed successfully.
Apr 14 14:32:57 user nova-compute[71347]: DEBUG nova.compute.manager [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquired lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG nova.network.neutron [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:32:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Releasing lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23230346137623633', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230346137623633', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.objects.instance [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'flavor' on Instance uuid 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:32:58 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:32:58 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:32:58 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:32:58 user nova-compute[71347]:   <serial>4669eb74-f961-4f6a-91c0-a9a14285ba7c</serial>
Apr 14 14:32:58 user nova-compute[71347]: </disk>
Apr 14 14:32:58 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] No VIF found with MAC fa:16:3e:36:b4:6b, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-de88a148-9365-467a-a2f8-f977311f3447 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.929s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:58 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance destroyed successfully.
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'resources' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-755157756',display_name='tempest-TestShelveInstance-server-755157756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-755157756',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKJoKJ0C1gwmcl9WN0481R6riIzUurMmeNe4HFPJSFtnAOso9CjS53uyvJdMv1WXI2soZXZFuXATdLz+HY8o19OMrATVnZBHoN6oICfZYn1/7aJe4UeWOor3ZtbYKjF6A==',key_name='tempest-TestShelveInstance-790180658',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:31:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8137fbeb0b0546eb9fd19b76bb8b6b7a',ramdisk_id='',reservation_id='r-wz0by5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1144252643',owner_user_name='tempest-TestShelveInstance-1144252643-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:31:15Z,user_data=None,user_id='bc2d448f2dfc45498252bab608df3446',uuid=ca57f876-a86b-4a47-b941-ea2fd63f1298,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converting VIF {"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_vif [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1219695c-8d, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:32:58 user nova-compute[71347]: INFO os_vif [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d')
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing instance network info cache due to event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] Acquiring lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] Acquired lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.network.neutron [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UstmfrpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:32:58 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[de32de68-2625-4d70-9d45-b3ab1e075f29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:32:58 user nova-compute[71347]: No targets found.
Apr 14 14:32:58 user nova-compute[71347]: iSNS:
Apr 14 14:32:58 user nova-compute[71347]: No targets found.
Apr 14 14:32:58 user nova-compute[71347]: STATIC:
Apr 14 14:32:58 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c
Apr 14 14:32:58 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:32:58 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:32:58 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06
Apr 14 14:32:58 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:32:58 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:32:58 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221
Apr 14 14:32:58 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:32:58 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:32:58 user nova-compute[71347]: FIRMWARE:
Apr 14 14:32:58 user nova-compute[71347]: No targets found.
Apr 14 14:32:58 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:32:58 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:32:58 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd8c87d-0af6-48fb-afc3-ef8d0d46724f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[decdcf49-931d-4d96-8e5e-5ad58f83f9e7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:32:58 user nova-compute[71347]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)
Apr 14 14:32:58 user nova-compute[71347]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)
Apr 14 14:32:58 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:32:58 user nova-compute[71347]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)
Apr 14 14:32:58 user nova-compute[71347]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)
Apr 14 14:32:58 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f500770f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5725ac04-7442-43fe-ae6d-4c90f93c78bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc1aed3-5d12-45ce-b66b-898abd5aad80]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f4a3c-1e85-474c-a1be-cd8c98a82798]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[023bd2cb-2a51-4ca4-967d-00db7ca6c929]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] No waiting events found dispatching network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:32:58 user nova-compute[71347]: WARNING nova.compute.manager [req-7d6e6710-a8c2-435b-b2ca-b35154d85fd1 req-4a383712-beec-4a9a-836f-0f5d329bafa1 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received unexpected event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance with vm_state active and task_state shelving.
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3608cbe-ff5a-48e7-a81a-75319ce8213c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[35085d24-f239-49a6-b068-c447d35d1fb1]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260]
Apr 14 14:32:58 user nova-compute[71347]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260] successful.
Apr 14 14:32:58 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b3575-4075-40dc-8459-c4134418af6b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] <== disconnect_volume: return (310ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:32:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:32:58 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Deleting instance files /opt/stack/data/nova/instances/ca57f876-a86b-4a47-b941-ea2fd63f1298_del
Apr 14 14:32:58 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Deletion of /opt/stack/data/nova/instances/ca57f876-a86b-4a47-b941-ea2fd63f1298_del complete
Apr 14 14:32:59 user nova-compute[71347]: DEBUG nova.network.neutron [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updated VIF entry in instance network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:32:59 user nova-compute[71347]: DEBUG nova.network.neutron [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": null, "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1219695c-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:32:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-eee86fa7-4bf6-4f69-8fc3-4265b59695ee req-109d7e19-6486-4f7f-85ac-182830f4cc53 service nova] Releasing lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:33:00 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Deleted allocations for instance ca57f876-a86b-4a47-b941-ea2fd63f1298
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'numa_topology' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:00 user nova-compute[71347]: INFO nova.compute.manager [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Detaching volume 4669eb74-f961-4f6a-91c0-a9a14285ba7c
Apr 14 14:33:00 user nova-compute[71347]: INFO nova.virt.block_device [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Attempting to driver detach volume 4669eb74-f961-4f6a-91c0-a9a14285ba7c from mountpoint /dev/vdb
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Attempting to detach device vdb from instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:33:00 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:33:00 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:33:00 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:33:00 user nova-compute[71347]:   <serial>4669eb74-f961-4f6a-91c0-a9a14285ba7c</serial>
Apr 14 14:33:00 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:33:00 user nova-compute[71347]: </disk>
Apr 14 14:33:00 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:33:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Successfully detached device vdb from instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 from the persistent domain config.
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:33:00 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:33:00 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:33:00 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:33:00 user nova-compute[71347]:   <serial>4669eb74-f961-4f6a-91c0-a9a14285ba7c</serial>
Apr 14 14:33:00 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:33:00 user nova-compute[71347]: </disk>
Apr 14 14:33:00 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5593a0a9-e472-468b-aad4-60d52868866a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.251s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482780.812202, 95a6c9af-12a8-440a-b27c-701fc24da3f7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:33:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Successfully detached device vdb from instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 from the live domain config.
Apr 14 14:33:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dabenPEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:33:00 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb21201-9989-41fd-9cd1-1fd30a8f55bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:33:00 user nova-compute[71347]: No targets found.
Apr 14 14:33:00 user nova-compute[71347]: iSNS:
Apr 14 14:33:00 user nova-compute[71347]: No targets found.
Apr 14 14:33:00 user nova-compute[71347]: STATIC:
Apr 14 14:33:00 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c
Apr 14 14:33:00 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:33:00 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:33:00 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06
Apr 14 14:33:00 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:33:00 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:33:00 user nova-compute[71347]: FIRMWARE:
Apr 14 14:33:00 user nova-compute[71347]: No targets found.
Apr 14 14:33:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:33:00 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:33:00 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ca502-9b14-4410-a334-534bdbbdee2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97e778b-307b-4175-a4b9-8de46012b3f1]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)
Apr 14 14:33:00 user nova-compute[71347]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)
Apr 14 14:33:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b798688a-a3f3-4aa8-a10f-8c55bc392d06 (non-flash)
Apr 14 14:33:00 user nova-compute[71347]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c (non-flash)
Apr 14 14:33:00 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd81c37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d057df86-ecf3-43c3-a739-e2338ac0c58a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f53e5b-1d09-4516-9375-f7a821f60390]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5cb0ee-909b-4cc6-9763-a3fdfe9fd9ec]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:33:00 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[847f0a04-77b6-44fc-93f8-0ea6cb0ee5e7]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52abe9a-f516-4659-8163-b52b3cfc2857]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed552316-8357-418c-bb0a-094f9f24fbd6]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c, portal: 172.16.0.220,3260]
Apr 14 14:33:01 user nova-compute[71347]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c, portal: 172.16.0.220,3260] successful.
Apr 14 14:33:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4669eb74-f961-4f6a-91c0-a9a14285ba7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc0ba0d-9f29-464a-8141-77564b15bc75]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] <== disconnect_volume: return (329ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:33:01 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'flavor' on Instance uuid 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ecdcad3a-219d-4ade-955f-8ad6717b8610 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.010s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:33:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:33:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:07 user nova-compute[71347]: INFO nova.compute.manager [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Terminating instance
Apr 14 14:33:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:07 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-unplugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] No waiting events found dispatching network-vif-unplugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-acfcc634-9839-403e-b4c5-9b83cd48f173 req-9a159b59-93db-4407-baeb-554686761830 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-unplugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Instance destroyed successfully.
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'resources' on Instance uuid 7c7956b5-905e-4a1a-b657-fe3aa5018258 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1496827',display_name='tempest-ServerRescueNegativeTestJSON-server-1496827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1496827',id=2,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:18:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-kgeq8ou2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:18:59Z,user_data=None,user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=7c7956b5-905e-4a1a-b657-fe3aa5018258,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "address": "fa:16:3e:df:88:c6", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5ceb2e-30", "ovs_interfaceid": "9c5ceb2e-307c-4e1c-9356-b14b40e04290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:88:c6,bridge_name='br-int',has_traffic_filtering=True,id=9c5ceb2e-307c-4e1c-9356-b14b40e04290,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ceb2e-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG os_vif [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:88:c6,bridge_name='br-int',has_traffic_filtering=True,id=9c5ceb2e-307c-4e1c-9356-b14b40e04290,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ceb2e-30') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c5ceb2e-30, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:33:08 user nova-compute[71347]: INFO os_vif [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:88:c6,bridge_name='br-int',has_traffic_filtering=True,id=9c5ceb2e-307c-4e1c-9356-b14b40e04290,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5ceb2e-30')
Apr 14 14:33:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Deleting instance files /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258_del
Apr 14 14:33:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Deletion of /opt/stack/data/nova/instances/7c7956b5-905e-4a1a-b657-fe3aa5018258_del complete
Apr 14 14:33:08 user nova-compute[71347]: INFO nova.compute.manager [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.compute.manager [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-deleted-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:09 user nova-compute[71347]: INFO nova.compute.manager [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Neutron deleted interface 9c5ceb2e-307c-4e1c-9356-b14b40e04290; detaching it from the instance and deleting it from the info cache
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.network.neutron [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:09 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Took 0.73 seconds to deallocate network for instance.
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.compute.manager [req-04a1b77f-7d4a-48a7-97e5-2c8670e17455 req-0be51ad8-3224-446a-9bbd-e57dd33f3b0c service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Detach interface failed, port_id=9c5ceb2e-307c-4e1c-9356-b14b40e04290, reason: Instance 7c7956b5-905e-4a1a-b657-fe3aa5018258 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:09 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '7c7956b5-905e-4a1a-b657-fe3aa5018258' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '7c7956b5-905e-4a1a-b657-fe3aa5018258' (instance-00000002)
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:09 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.751s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:10 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Deleted allocations for instance 7c7956b5-905e-4a1a-b657-fe3aa5018258
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b2f45923-b45c-4c3a-8154-472d69fa29ab tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] Acquiring lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] Lock "7c7956b5-905e-4a1a-b657-fe3aa5018258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] No waiting events found dispatching network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:33:10 user nova-compute[71347]: WARNING nova.compute.manager [req-6fbdcdbf-9e5b-4fdd-b784-115345d4818b req-28031f49-26c4-4faa-af2d-1aa714a44f05 service nova] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Received unexpected event network-vif-plugged-9c5ceb2e-307c-4e1c-9356-b14b40e04290 for instance with vm_state deleted and task_state None.
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:10 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:33:10 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:33:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=26.344226837158203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 30643f90-4347-4b1e-b1ca-57e69e716fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fc7da5e7-7b87-458f-82b1-055664003a85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance cba499ef-3621-4516-875f-492eef042874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482777.1568503, ca57f876-a86b-4a47-b941-ea2fd63f1298 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:33:12 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] VM Stopped (Lifecycle Event)
Apr 14 14:33:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d292fef2-a0eb-4d95-b90f-702c0b6965e8 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updating instance_info_cache with network_info: [{"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:33:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:23 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482788.4569192, 7c7956b5-905e-4a1a-b657-fe3aa5018258 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:33:23 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] VM Stopped (Lifecycle Event)
Apr 14 14:33:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-607fbd1c-6876-4333-9e66-4c66a005fd34 None None] [instance: 7c7956b5-905e-4a1a-b657-fe3aa5018258] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:33:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received event network-changed-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:25 user nova-compute[71347]: DEBUG nova.compute.manager [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Refreshing instance network info cache due to event network-changed-f7107c4c-5255-44d3-bb66-e89affe36f75. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:33:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] Acquiring lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:33:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] Acquired lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:33:25 user nova-compute[71347]: DEBUG nova.network.neutron [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Refreshing network info cache for port f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:33:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Updated VIF entry in instance network info cache for port f7107c4c-5255-44d3-bb66-e89affe36f75. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:33:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Updating instance_info_cache with network_info: [{"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d08e9cf5-a96f-4b73-967b-6f7fc02da31f req-e655d821-28b4-402d-8152-668e8ab877ce service nova] Releasing lock "refresh_cache-a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG nova.objects.instance [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:28 user nova-compute[71347]: INFO nova.compute.manager [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Attaching volume 4aa2ee2b-7a17-4118-ae50-075e9c02f9ba to /dev/vdb
Apr 14 14:33:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG os_brick.utils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f126b94a-59bc-47ce-b2ee-387f399785b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[55554f3b-7aa9-473e-a75f-762b42c0855a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[97203c8c-c8fb-463e-962b-b37495e21c55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6e02ab-4ab3-4f1d-a969-17bd10c5884b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:33:28 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:33:28 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfe4c63-986a-4711-9f27-242f068ee536]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG os_brick.utils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:33:28 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Updating existing volume attachment record: 67012d9e-249a-4c35-b1a1-b8ad1dfbe82f {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:33:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-changed-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Refreshing instance network info cache due to event network-changed-a7f26438-6282-4bdb-a730-cddb218c10ce. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:33:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] Acquiring lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:33:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] Acquired lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:33:30 user nova-compute[71347]: DEBUG nova.network.neutron [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Refreshing network info cache for port a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:33:30 user nova-compute[71347]: DEBUG nova.network.neutron [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updated VIF entry in instance network info cache for port a7f26438-6282-4bdb-a730-cddb218c10ce. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:33:30 user nova-compute[71347]: DEBUG nova.network.neutron [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updating instance_info_cache with network_info: [{"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4f2b8082-706a-4470-85f7-c54ca28840c1 req-3d122968-c0b7-4235-bf7d-cfdd2cda2b18 service nova] Releasing lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVMGuYNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:33:33 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:33:33 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:33:33 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c057ea-25b6-4a0e-b52c-cd86bc7c20cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:33:33 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb86780d-4be4-4aa9-bc30-6081f6cd06a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba] added
Apr 14 14:33:33 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13bcc08-d876-4e8c-be05-fb84701f21f9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f507d2-11ec-4c10-b217-49e702b9fc7d]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wVMGuYNt {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wVMGuYNt" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b0014f-a442-49a3-a09e-3b4b205656bc]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wVMGuYNt'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[856fbe9a-88c8-4645-adba-9e4cc740a8b1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9f7a6c-1a01-4613-ae48-1c297d59b77c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:33:33 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:33:33 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:33:33 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:33:33 user nova-compute[71347]: 
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26ec60a-c9a4-4bbc-956d-eff09d82a351]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba, portal: 172.16.0.220,3260]
Apr 14 14:33:33 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba, portal: 172.16.0.220,3260] successful.
Apr 14 14:33:33 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[84507566-ccd1-4645-814e-cdca7bfbbe9a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[96083e20-f48c-4b22-80c4-34a7418ff803]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba (non-flash)
Apr 14 14:33:33 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba (non-flash)
Apr 14 14:33:33 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a999ce-21a9-4747-a5ae-fd1ce560e465]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVMGuYNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:33:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:33:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23961386165643631', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:33:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961386165643631', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:33:34 user nova-compute[71347]: DEBUG nova.objects.instance [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:33:34 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:33:34 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:33:34 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:33:34 user nova-compute[71347]:   <serial>4aa2ee2b-7a17-4118-ae50-075e9c02f9ba</serial>
Apr 14 14:33:34 user nova-compute[71347]: </disk>
Apr 14 14:33:34 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:33:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:33:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:33:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] No VIF found with MAC fa:16:3e:ab:22:33, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:33:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86e73a72-85eb-4128-bb4e-215f7c16ae7b tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.708s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:33:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:35 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:33:35 user nova-compute[71347]: INFO nova.compute.claims [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Claim successful on node user
Apr 14 14:33:35 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:33:35 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:33:36 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:33:36 user nova-compute[71347]: INFO nova.virt.block_device [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Booting with volume 9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 at /dev/vda
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.policy [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '797d2d1bff8e4b26afe7856e4c3877cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b087f26a80045f3844873220a67a4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG os_brick.utils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ad921a-029c-4766-b1c2-b3418e92355b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b5d629-1889-4fdd-a00f-21675677f316]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ba770-4d7e-43f4-80bc-b155a85d2274]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50487ec-e81c-4cd5-bb58-d947f6f6f6c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:33:36 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0856115b-0cf0-4732-bb8f-a266b4cc20ef]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG os_brick.utils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating existing volume attachment record: 00e22960-ed1b-4b8a-8d6a-09a65d3c0141 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:36 user nova-compute[71347]: INFO nova.compute.manager [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Detaching volume 4aa2ee2b-7a17-4118-ae50-075e9c02f9ba
Apr 14 14:33:36 user nova-compute[71347]: INFO nova.virt.block_device [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Attempting to driver detach volume 4aa2ee2b-7a17-4118-ae50-075e9c02f9ba from mountpoint /dev/vdb
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Attempting to detach device vdb from instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:33:36 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:33:36 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:33:36 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:33:36 user nova-compute[71347]:   <serial>4aa2ee2b-7a17-4118-ae50-075e9c02f9ba</serial>
Apr 14 14:33:36 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:33:36 user nova-compute[71347]: </disk>
Apr 14 14:33:36 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:33:36 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully detached device vdb from instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 from the persistent domain config.
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:33:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:33:36 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:33:36 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:33:36 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:33:36 user nova-compute[71347]:   <serial>4aa2ee2b-7a17-4118-ae50-075e9c02f9ba</serial>
Apr 14 14:33:36 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:33:36 user nova-compute[71347]: </disk>
Apr 14 14:33:36 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482817.0715587, a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:33:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully detached device vdb from instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 from the live domain config.
Apr 14 14:33:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wVMGuYNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:33:37 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d52c31-d9b6-404e-a56b-825ba6771414]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:33:37 user nova-compute[71347]: No targets found.
Apr 14 14:33:37 user nova-compute[71347]: iSNS:
Apr 14 14:33:37 user nova-compute[71347]: No targets found.
Apr 14 14:33:37 user nova-compute[71347]: STATIC:
Apr 14 14:33:37 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba
Apr 14 14:33:37 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:33:37 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:33:37 user nova-compute[71347]: FIRMWARE:
Apr 14 14:33:37 user nova-compute[71347]: No targets found.
Apr 14 14:33:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:33:37 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:33:37 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d9df87-79e5-499a-a83f-2a13fcadfe77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4707fbb1-8035-4756-8f76-c5e94b1d5a24]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba (non-flash)
Apr 14 14:33:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba (non-flash)
Apr 14 14:33:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4f228c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4b7da4-7b86-4a41-b572-04cd73f427ab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd9b15e-bca9-4072-b24f-9a796338a323]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Successfully created port: 749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbfb551-1511-4976-b107-b7bdcd796d47]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391b992-f838-4d30-8a8c-7239650fba38]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9636736e-c2c8-4445-832d-17a84c42cc37]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[223a1917-ba53-47fe-966c-5000fd1dbedd]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba, portal: 172.16.0.220,3260]
Apr 14 14:33:37 user nova-compute[71347]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba, portal: 172.16.0.220,3260] successful.
Apr 14 14:33:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa2ee2b-7a17-4118-ae50-075e9c02f9ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8941029f-7714-4cab-ba96-665e51b0176b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] <== disconnect_volume: return (323ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:33:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Successfully updated port: 749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-changed-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Refreshing instance network info cache due to event network-changed-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] Acquiring lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'flavor' on Instance uuid a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6d519c02-bc53-4697-ac7f-b7c2fd4bcc00 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.780s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance network_info: |[{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] Acquired lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Refreshing network info cache for port 749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updated VIF entry in instance network info cache for port 749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6fe84924-daf0-4d70-87f0-52cc17b989d9 req-6db5152f-a595-4eb4-9137-4b72adf42b56 service nova] Releasing lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:33:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Creating image(s)
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Ensure instance console log exists: /opt/stack/data/nova/instances/6d350d39-ba90-4e7f-8f95-bf565f787b0a/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Start _get_guest_xml network_info=[{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSVlLBgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d350d39-ba90-4e7f-8f95-bf565f787b0a', 'attached_at': '', 'detached_at': '', 'volume_id': '9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'serial': '9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1'}, 'attachment_id': '00e22960-ed1b-4b8a-8d6a-09a65d3c0141', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:33:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:33:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSVlLBgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:33:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:33:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:33:41 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b66f08-85a5-41da-808b-51de01d7006b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:33:41 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[29822321-a9e0-41f2-88f9-19a45cd6a934]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1] added
Apr 14 14:33:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d791c8ea-8d91-4659-a682-758a921d8057]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d762c5c-3c5c-4321-bcb6-c13d1c94cb69]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSVlLBgT {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSVlLBgT" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe85c01-732a-4bce-a729-5c6898008762]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WSVlLBgT'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2625d-16b7-4125-ae07-2d08fa39c0c2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[865cd097-6e9e-43d2-9bdd-978b2b984c4c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:33:41 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:33:41 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:33:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:33:41 user nova-compute[71347]: 
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8c52d2-287b-4ceb-8c33-2f34d8a4a7de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260]
Apr 14 14:33:41 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260] successful.
Apr 14 14:33:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[76625944-3bf0-464a-812f-5740f66dedef]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd759a5b-d67e-4c6e-8d02-dd34c2d47647]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:33:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:33:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5680e9e8-ccf0-4172-b41a-8b37b98d42b4]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:33:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSVlLBgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23835663565393264', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835663565393264', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842987954',display_name='tempest-ServerActionsTestJSON-server-1842987954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842987954',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-85xknzdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=6d350d39-ba90-4e7f-8f95-bf565f787b0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.objects.instance [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:33:42 user nova-compute[71347]:   <uuid>6d350d39-ba90-4e7f-8f95-bf565f787b0a</uuid>
Apr 14 14:33:42 user nova-compute[71347]:   <name>instance-00000021</name>
Apr 14 14:33:42 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:33:42 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:33:42 user nova-compute[71347]:   <metadata>
Apr 14 14:33:42 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:33:42 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:33:42 user nova-compute[71347]:       <nova:name>tempest-ServerActionsTestJSON-server-1842987954</nova:name>
Apr 14 14:33:42 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:33:41</nova:creationTime>
Apr 14 14:33:42 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:33:42 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:33:42 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:33:42 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:33:42 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:33:42 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:33:42 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:33:42 user nova-compute[71347]:       <nova:owner>
Apr 14 14:33:42 user nova-compute[71347]:         <nova:user uuid="797d2d1bff8e4b26afe7856e4c3877cf">tempest-ServerActionsTestJSON-932644409-project-member</nova:user>
Apr 14 14:33:42 user nova-compute[71347]:         <nova:project uuid="3b087f26a80045f3844873220a67a4e4">tempest-ServerActionsTestJSON-932644409</nova:project>
Apr 14 14:33:42 user nova-compute[71347]:       </nova:owner>
Apr 14 14:33:42 user nova-compute[71347]:       <nova:ports>
Apr 14 14:33:42 user nova-compute[71347]:         <nova:port uuid="749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1">
Apr 14 14:33:42 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 14:33:42 user nova-compute[71347]:         </nova:port>
Apr 14 14:33:42 user nova-compute[71347]:       </nova:ports>
Apr 14 14:33:42 user nova-compute[71347]:     </nova:instance>
Apr 14 14:33:42 user nova-compute[71347]:   </metadata>
Apr 14 14:33:42 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:33:42 user nova-compute[71347]:     <system>
Apr 14 14:33:42 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:33:42 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:33:42 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:33:42 user nova-compute[71347]:       <entry name="serial">6d350d39-ba90-4e7f-8f95-bf565f787b0a</entry>
Apr 14 14:33:42 user nova-compute[71347]:       <entry name="uuid">6d350d39-ba90-4e7f-8f95-bf565f787b0a</entry>
Apr 14 14:33:42 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:33:42 user nova-compute[71347]:     </system>
Apr 14 14:33:42 user nova-compute[71347]:   </sysinfo>
Apr 14 14:33:42 user nova-compute[71347]:   <os>
Apr 14 14:33:42 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:33:42 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:33:42 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:33:42 user nova-compute[71347]:   </os>
Apr 14 14:33:42 user nova-compute[71347]:   <features>
Apr 14 14:33:42 user nova-compute[71347]:     <acpi/>
Apr 14 14:33:42 user nova-compute[71347]:     <apic/>
Apr 14 14:33:42 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:33:42 user nova-compute[71347]:   </features>
Apr 14 14:33:42 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:33:42 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:33:42 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:33:42 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:33:42 user nova-compute[71347]:   </clock>
Apr 14 14:33:42 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:33:42 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:33:42 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:33:42 user nova-compute[71347]:   </cpu>
Apr 14 14:33:42 user nova-compute[71347]:   <devices>
Apr 14 14:33:42 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:33:42 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:33:42 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:33:42 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:33:42 user nova-compute[71347]:       <serial>9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1</serial>
Apr 14 14:33:42 user nova-compute[71347]:     </disk>
Apr 14 14:33:42 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:33:42 user nova-compute[71347]:       <mac address="fa:16:3e:22:07:00"/>
Apr 14 14:33:42 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:33:42 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:33:42 user nova-compute[71347]:       <target dev="tap749a0a24-f4"/>
Apr 14 14:33:42 user nova-compute[71347]:     </interface>
Apr 14 14:33:42 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:33:42 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/6d350d39-ba90-4e7f-8f95-bf565f787b0a/console.log" append="off"/>
Apr 14 14:33:42 user nova-compute[71347]:     </serial>
Apr 14 14:33:42 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:33:42 user nova-compute[71347]:     <video>
Apr 14 14:33:42 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:33:42 user nova-compute[71347]:     </video>
Apr 14 14:33:42 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:33:42 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:33:42 user nova-compute[71347]:     </rng>
Apr 14 14:33:42 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:33:42 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:33:42 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:33:42 user nova-compute[71347]:     </memballoon>
Apr 14 14:33:42 user nova-compute[71347]:   </devices>
Apr 14 14:33:42 user nova-compute[71347]: </domain>
Apr 14 14:33:42 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842987954',display_name='tempest-ServerActionsTestJSON-server-1842987954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842987954',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-85xknzdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=6d350d39-ba90-4e7f-8f95-bf565f787b0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG os_vif [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap749a0a24-f4, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap749a0a24-f4, col_values=(('external_ids', {'iface-id': '749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:07:00', 'vm-uuid': '6d350d39-ba90-4e7f-8f95-bf565f787b0a'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:42 user nova-compute[71347]: INFO os_vif [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4')
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:33:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No VIF found with MAC fa:16:3e:22:07:00, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:33:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:33:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] No waiting events found dispatching network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:33:44 user nova-compute[71347]: WARNING nova.compute.manager [req-fa079051-0175-42c0-a5dc-4af469276d12 req-d83f4a3e-891b-4f2e-a5bd-8d7a0a6b6b02 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received unexpected event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance with vm_state building and task_state spawning.
Apr 14 14:33:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 48dc94a3-6933-475b-8803-828acc9d6577 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "48dc94a3-6933-475b-8803-828acc9d6577" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "48dc94a3-6933-475b-8803-828acc9d6577" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "48dc94a3-6933-475b-8803-828acc9d6577" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482825.9185412, 6d350d39-ba90-4e7f-8f95-bf565f787b0a => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:33:45 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] VM Resumed (Lifecycle Event)
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:33:45 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance spawned successfully.
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:33:45 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482825.9194722, 6d350d39-ba90-4e7f-8f95-bf565f787b0a => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:33:45 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] VM Started (Lifecycle Event)
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:33:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:33:46 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:33:46 user nova-compute[71347]: INFO nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Took 4.90 seconds to spawn the instance on the hypervisor.
Apr 14 14:33:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:33:46 user nova-compute[71347]: INFO nova.compute.manager [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Took 10.50 seconds to build instance.
Apr 14 14:33:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] No waiting events found dispatching network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:33:46 user nova-compute[71347]: WARNING nova.compute.manager [req-91bd1088-2dce-4822-a344-060ff254120c req-cacd7052-974e-4fcc-9a87-d2f5122f682a service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received unexpected event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance with vm_state active and task_state None.
Apr 14 14:33:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-7abe33e3-1413-4a93-aca2-99cc0c9841bd tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.602s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.888s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:46 user nova-compute[71347]: INFO nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:33:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-changed-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Refreshing instance network info cache due to event network-changed-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] Acquiring lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] Acquired lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Refreshing network info cache for port 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:51 user nova-compute[71347]: INFO nova.compute.manager [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Terminating instance
Apr 14 14:33:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Instance destroyed successfully.
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'resources' on Instance uuid 95a6c9af-12a8-440a-b27c-701fc24da3f7 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2070944659',display_name='tempest-TestStampPattern-server-2070944659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2070944659',id=28,image_ref='25145ae9-9290-432b-9bc8-6eb80cf99145',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVd5d8f1BuBRppDw9HXKQyu3/1iOI3YZuUkyUZmTb2VBMBhBMIyRKqpoaUA5/dZnFrRfFPyALC45bswJQWvC/+I/l7V8YK8+DU0/n020XSkmcHMDH6Po4guzWitPY9ppA==',key_name='tempest-TestStampPattern-594781561',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:31:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e043301622414bb492b48f0c6366a2',ramdisk_id='',reservation_id='r-koa0w0je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='fc7da5e7-7b87-458f-82b1-055664003a85',image_min_disk='1',image_min_ram='0',image_owner_id='51e043301622414bb492b48f0c6366a2',image_owner_project_name='tempest-TestStampPattern-523457803',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-523457803-project-member',image_user_id='b5bccb6643e84c53ab7f1301bdf0cb97',owner_project_name='tempest-TestStampPattern-523457803',owner_user_name='tempest-TestStampPattern-523457803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:31:06Z,user_data=None,user_id='b5bccb6643e84c53ab7f1301bdf0cb97',uuid=95a6c9af-12a8-440a-b27c-701fc24da3f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converting VIF {"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:b4:6b,bridge_name='br-int',has_traffic_filtering=True,id=8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb4ea6e-fe') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG os_vif [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:b4:6b,bridge_name='br-int',has_traffic_filtering=True,id=8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb4ea6e-fe') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eb4ea6e-fe, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:33:52 user nova-compute[71347]: INFO os_vif [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:b4:6b,bridge_name='br-int',has_traffic_filtering=True,id=8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eb4ea6e-fe')
Apr 14 14:33:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Deleting instance files /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7_del
Apr 14 14:33:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Deletion of /opt/stack/data/nova/instances/95a6c9af-12a8-440a-b27c-701fc24da3f7_del complete
Apr 14 14:33:52 user nova-compute[71347]: INFO nova.compute.manager [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 14:33:52 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-vif-unplugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] No waiting events found dispatching network-vif-unplugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-cf11f995-5435-4362-a513-6463c2f1088d req-496a72cc-44bc-405d-9dd8-b95cf3abd38c service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-vif-unplugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updated VIF entry in instance network info cache for port 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updating instance_info_cache with network_info: [{"id": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "address": "fa:16:3e:36:b4:6b", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eb4ea6e-fe", "ovs_interfaceid": "8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5a869850-7c35-41ee-9d5f-8248b7acd0bc req-dbe37812-8cb6-4cdd-a570-19544afe399b service nova] Releasing lock "refresh_cache-95a6c9af-12a8-440a-b27c-701fc24da3f7" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:52 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Took 0.59 seconds to deallocate network for instance.
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-vif-deleted-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:52 user nova-compute[71347]: INFO nova.compute.manager [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Neutron deleted interface 8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b; detaching it from the instance and deleting it from the info cache
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-2075114b-c9db-4ef4-880a-534c43fea8b5 req-07432a10-b16d-4d35-a6b8-785d4dc5d2f2 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Detach interface failed, port_id=8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b, reason: Instance 95a6c9af-12a8-440a-b27c-701fc24da3f7 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:53 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:33:53 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:33:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:53 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Deleted allocations for instance 95a6c9af-12a8-440a-b27c-701fc24da3f7
Apr 14 14:33:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ddc161ff-6054-4fd8-bbeb-611033846a81 tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received event network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] Acquiring lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] Lock "95a6c9af-12a8-440a-b27c-701fc24da3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] No waiting events found dispatching network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:33:54 user nova-compute[71347]: WARNING nova.compute.manager [req-cdb6384d-bd7b-4c1d-8f37-7f97181ee767 req-39768025-9e1a-487e-a538-7c26289b2918 service nova] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Received unexpected event network-vif-plugged-8eb4ea6e-fe58-45c3-b4ee-0cc28ab0a54b for instance with vm_state deleted and task_state None.
Apr 14 14:33:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:58 user nova-compute[71347]: INFO nova.compute.manager [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Terminating instance
Apr 14 14:33:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:33:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-01874c41-cbd1-481d-8589-b43ea2ade8ff req-56f3f658-4fd1-4f74-9fbd-a3af937ad21f service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-unplugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:33:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Instance destroyed successfully.
Apr 14 14:33:59 user nova-compute[71347]: DEBUG nova.objects.instance [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lazy-loading 'resources' on Instance uuid 30643f90-4347-4b1e-b1ca-57e69e716fb4 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-667599017',display_name='tempest-ServerRescueNegativeTestJSON-server-667599017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-667599017',id=1,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b53efd997e3e47d898264dae8a27a5ad',ramdisk_id='',reservation_id='r-jq8kt60n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1435712120',owner_user_name='tempest-ServerRescueNegativeTestJSON-1435712120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:23:43Z,user_data=None,user_id='cdfcb787b0f545f8b19e947d54d07b9c',uuid=30643f90-4347-4b1e-b1ca-57e69e716fb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converting VIF {"id": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "address": "fa:16:3e:ad:22:e9", "network": {"id": "ad43cdc7-07dc-4fda-bc56-3290a2d03c80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-798566716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b53efd997e3e47d898264dae8a27a5ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a957ddb-f2", "ovs_interfaceid": "1a957ddb-f21a-4f08-8309-8c866fd2d6c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:22:e9,bridge_name='br-int',has_traffic_filtering=True,id=1a957ddb-f21a-4f08-8309-8c866fd2d6c4,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a957ddb-f2') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG os_vif [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:22:e9,bridge_name='br-int',has_traffic_filtering=True,id=1a957ddb-f21a-4f08-8309-8c866fd2d6c4,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a957ddb-f2') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a957ddb-f2, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:33:59 user nova-compute[71347]: INFO os_vif [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:22:e9,bridge_name='br-int',has_traffic_filtering=True,id=1a957ddb-f21a-4f08-8309-8c866fd2d6c4,network=Network(ad43cdc7-07dc-4fda-bc56-3290a2d03c80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a957ddb-f2')
Apr 14 14:33:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Deleting instance files /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4_del
Apr 14 14:33:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Deletion of /opt/stack/data/nova/instances/30643f90-4347-4b1e-b1ca-57e69e716fb4_del complete
Apr 14 14:33:59 user nova-compute[71347]: INFO nova.compute.manager [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 14:33:59 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:33:59 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Took 0.51 seconds to deallocate network for instance.
Apr 14 14:33:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:33:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:00 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:34:00 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:34:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:00 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Deleted allocations for instance 30643f90-4347-4b1e-b1ca-57e69e716fb4
Apr 14 14:34:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-8779e945-069c-4285-8e7f-42bd1bfc8e0c tempest-ServerRescueNegativeTestJSON-1435712120 tempest-ServerRescueNegativeTestJSON-1435712120-project-member] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.739s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Acquiring lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] Lock "30643f90-4347-4b1e-b1ca-57e69e716fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] No waiting events found dispatching network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:34:00 user nova-compute[71347]: WARNING nova.compute.manager [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received unexpected event network-vif-plugged-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 for instance with vm_state deleted and task_state None.
Apr 14 14:34:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1fd32fb5-cadb-4b3f-afe6-4d3261dfcddc req-424fb433-da55-4e04-a600-b27289260ab4 service nova] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Received event network-vif-deleted-1a957ddb-f21a-4f08-8309-8c866fd2d6c4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:04 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:07 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482832.1395202, 95a6c9af-12a8-440a-b27c-701fc24da3f7 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:34:07 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] VM Stopped (Lifecycle Event)
Apr 14 14:34:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4c974140-6d1b-4c0e-b5a4-ee0c58ed8467 None None] [instance: 95a6c9af-12a8-440a-b27c-701fc24da3f7] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:34:07 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:07 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:34:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:34:09 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:09 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:09 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:09 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:10 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:11 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:34:11 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8168MB free_disk=26.400634765625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance fc7da5e7-7b87-458f-82b1-055664003a85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance cba499ef-3621-4516-875f-492eef042874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:34:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:34:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:34:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:34:14 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482839.3119683, 30643f90-4347-4b1e-b1ca-57e69e716fb4 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:34:14 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] VM Stopped (Lifecycle Event)
Apr 14 14:34:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ad90603c-c81c-45e2-91ba-ec8937fcb8d6 None None] [instance: 30643f90-4347-4b1e-b1ca-57e69e716fb4] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:34:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:34:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received event network-changed-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Refreshing instance network info cache due to event network-changed-14f10c1f-44c6-4ddb-9dcd-16205410ce60. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:34:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] Acquiring lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:34:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] Acquired lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:34:23 user nova-compute[71347]: DEBUG nova.network.neutron [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Refreshing network info cache for port 14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:34:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:34:24 user nova-compute[71347]: DEBUG nova.network.neutron [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Updated VIF entry in instance network info cache for port 14f10c1f-44c6-4ddb-9dcd-16205410ce60. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:34:24 user nova-compute[71347]: DEBUG nova.network.neutron [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Updating instance_info_cache with network_info: [{"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:34:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a875dfc2-4b27-4af1-a03d-2f7158582668 req-1f6e89e3-a1cc-4355-980c-88ea876608ca service nova] Releasing lock "refresh_cache-cba499ef-3621-4516-875f-492eef042874" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:27 user nova-compute[71347]: INFO nova.compute.manager [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Terminating instance
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received event network-vif-unplugged-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] No waiting events found dispatching network-vif-unplugged-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-a8a5d406-2626-47e1-af2e-04037b203d37 req-290e4380-d03f-4c01-a98b-c1779b64d5a8 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received event network-vif-unplugged-f7107c4c-5255-44d3-bb66-e89affe36f75 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.objects.instance [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:27 user nova-compute[71347]: INFO nova.compute.manager [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Attaching volume 38d3efe2-64e7-4338-bf17-40c6053527e9 to /dev/vdb
Apr 14 14:34:27 user nova-compute[71347]: DEBUG os_brick.utils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab34591-245a-48d9-bf3f-151cf8c9a452]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:27 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Instance destroyed successfully.
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbe14ab-4221-4831-8127-75a8bcd7104e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.objects.instance [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lazy-loading 'resources' on Instance uuid a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1099630364',display_name='tempest-AttachVolumeNegativeTest-server-1099630364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1099630364',id=30,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBhFalSigEmM/qdeFp13swzmTqKkKdefyD8LEgpHWpeke9RVOd9xVI6DSJsz57YRHcM+YiKIpcv+9Xi/T4Xj+WbcZjFvIwe3H0tvDuHt0gBs4Mt8I3sT+uJbbG8uU5tag==',key_name='tempest-keypair-1386274115',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df56fb88b961464496757a358fd15169',ramdisk_id='',reservation_id='r-qflqtwrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-134968716',owner_user_name='tempest-AttachVolumeNegativeTest-134968716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5db83169bedc4520b5e2a2b595362ec1',uuid=a30fcbc6-d8b3-42cd-8bac-fb425bb5a680,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converting VIF {"id": "f7107c4c-5255-44d3-bb66-e89affe36f75", "address": "fa:16:3e:ab:22:33", "network": {"id": "788caf36-1098-4d17-b6c9-0a12d0019dca", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-947334171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df56fb88b961464496757a358fd15169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7107c4c-52", "ovs_interfaceid": "f7107c4c-5255-44d3-bb66-e89affe36f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:22:33,bridge_name='br-int',has_traffic_filtering=True,id=f7107c4c-5255-44d3-bb66-e89affe36f75,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7107c4c-52') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG os_vif [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:22:33,bridge_name='br-int',has_traffic_filtering=True,id=f7107c4c-5255-44d3-bb66-e89affe36f75,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7107c4c-52') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7107c4c-52, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb429c23-3360-4528-a30b-c02c8d82d4ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[817b800c-24d6-4ce2-8147-7fbb6e45cf70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:34:27 user nova-compute[71347]: INFO os_vif [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:22:33,bridge_name='br-int',has_traffic_filtering=True,id=f7107c4c-5255-44d3-bb66-e89affe36f75,network=Network(788caf36-1098-4d17-b6c9-0a12d0019dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7107c4c-52')
Apr 14 14:34:27 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Deleting instance files /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680_del
Apr 14 14:34:27 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Deletion of /opt/stack/data/nova/instances/a30fcbc6-d8b3-42cd-8bac-fb425bb5a680_del complete
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:34:27 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf12cd6-7545-43fd-89b6-be251b92d3e2]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG os_brick.utils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Updating existing volume attachment record: 86c79325-27ad-47a4-95db-2b7152c7a1a5 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:34:27 user nova-compute[71347]: INFO nova.compute.manager [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 14:34:27 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:34:27 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:34:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:28 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:34:28 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Took 0.86 seconds to deallocate network for instance.
Apr 14 14:34:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received event network-vif-deleted-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:28 user nova-compute[71347]: INFO nova.compute.manager [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Neutron deleted interface f7107c4c-5255-44d3-bb66-e89affe36f75; detaching it from the instance and deleting it from the info cache
Apr 14 14:34:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:34:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-c90eb20f-9ae6-448c-8d4c-8649c9f2d024 req-593a3916-a714-429a-9e7b-99c578baff4f service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Detach interface failed, port_id=f7107c4c-5255-44d3-bb66-e89affe36f75, reason: Instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:34:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:29 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:34:29 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:34:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:29 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Deleted allocations for instance a30fcbc6-d8b3-42cd-8bac-fb425bb5a680
Apr 14 14:34:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-653907b6-c35e-4ad0-82e8-5695de07ca01 tempest-AttachVolumeNegativeTest-134968716 tempest-AttachVolumeNegativeTest-134968716-project-member] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received event network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] Acquiring lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] Lock "a30fcbc6-d8b3-42cd-8bac-fb425bb5a680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] No waiting events found dispatching network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:34:29 user nova-compute[71347]: WARNING nova.compute.manager [req-ae8eb656-8a3d-41be-8ef1-bfdba28f59f5 req-3aa61ee8-a791-4194-97a1-e4c43071d8e3 service nova] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Received unexpected event network-vif-plugged-f7107c4c-5255-44d3-bb66-e89affe36f75 for instance with vm_state deleted and task_state None.
Apr 14 14:34:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdmWBpOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:34:32 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:34:32 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:34:32 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[838d2341-fbcf-4783-8818-57d49bdade56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:34:32 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c290e0de-b8b0-4d7c-8aae-8006657087b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9] added
Apr 14 14:34:32 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf5ea1-4c1f-4d26-8acc-00139f2f02a2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f486cc96-ec29-4518-bce8-2683edfe8246]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdmWBpOq {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdmWBpOq" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[048e4cc7-0760-4252-a1e7-b95ac50c1311]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zdmWBpOq'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc32ae-08ed-4f2b-b528-40d8b1901eb6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[09520eea-21e7-4901-b5b2-ed745aba3417]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:32 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:32 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3b4136-9cd9-402d-96ad-47d4520724d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9, portal: 172.16.0.220,3260]
Apr 14 14:34:32 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9, portal: 172.16.0.220,3260] successful.
Apr 14 14:34:32 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ca7db-b2c8-4943-b980-8f77cbcf02bd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96b1f3-6f1f-40eb-a1f3-98ad188a3741]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:32 user nova-compute[71347]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)
Apr 14 14:34:32 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:32 user nova-compute[71347]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)
Apr 14 14:34:32 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cee061-8616-4c58-88c2-a1259827a0f2]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:34:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdmWBpOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:34:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:34:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26663326564393733', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:34:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663326564393733', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:34:33 user nova-compute[71347]: DEBUG nova.objects.instance [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:34:33 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:34:33 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:34:33 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:34:33 user nova-compute[71347]:   <serial>38d3efe2-64e7-4338-bf17-40c6053527e9</serial>
Apr 14 14:34:33 user nova-compute[71347]: </disk>
Apr 14 14:34:33 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:34:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:34:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:34:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No VIF found with MAC fa:16:3e:8e:57:4b, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:34:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-a954572e-588f-4352-a37c-6c8382ebb135 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.791s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:38 user nova-compute[71347]: INFO nova.compute.manager [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Attaching volume cc9cf91c-7eeb-44f2-807e-8ec378a901f9 to /dev/vdc
Apr 14 14:34:38 user nova-compute[71347]: DEBUG os_brick.utils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd457f0-1526-4d36-9c26-0c6680f5682b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[add68e9e-996c-4494-88da-08136870ef00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda30c8-6ec2-4b4d-ae89-fe655ce090e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e9b251-e860-4469-82f8-17ebfe4cdbae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:34:38 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:34:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dcdb83-b97c-4b73-a160-24d3fadad457]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG os_brick.utils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:34:38 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Updating existing volume attachment record: db409a13-99b2-484a-869b-8ea2579d9ac5 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:34:42 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482867.8235078, a30fcbc6-d8b3-42cd-8bac-fb425bb5a680 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:34:42 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] VM Stopped (Lifecycle Event)
Apr 14 14:34:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-810c85e5-c782-4897-89c8-1efc2af155de None None] [instance: a30fcbc6-d8b3-42cd-8bac-fb425bb5a680] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:34:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmVKeSDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:34:43 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:34:43 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:34:43 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bebc36c-9fcc-4223-999e-e14c0cddff71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:34:43 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d246e-ab21-4354-a218-88e651077453]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9] added
Apr 14 14:34:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94d2853-c000-47f4-b2ab-4b7ccf867217]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[70075f80-f140-4c19-80d3-6b65d8932f24]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmVKeSDW {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmVKeSDW" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d2691-e798-40e9-beaf-e91e5247246c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NmVKeSDW'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9edc6f4-1007-48cb-bae0-543c7d11f4a6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bf994c-0dab-4f57-b682-323148e616ea]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[522b54d7-1a94-4ced-b3a6-002669c05b38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9, portal: 172.16.0.220,3260]
Apr 14 14:34:43 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9, portal: 172.16.0.220,3260] successful.
Apr 14 14:34:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f61fae-8264-40d0-ae65-c60ff1039873]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db59038-0aed-4900-8670-4e91fb5337f2]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)
Apr 14 14:34:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2857c1ad-4052-405b-be9b-d0def2e76f23]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:34:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmVKeSDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23365323864383663', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365323864383663', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG nova.objects.instance [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:34:44 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:34:44 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:34:44 user nova-compute[71347]:   <target dev="vdc" bus="virtio"/>
Apr 14 14:34:44 user nova-compute[71347]:   <serial>cc9cf91c-7eeb-44f2-807e-8ec378a901f9</serial>
Apr 14 14:34:44 user nova-compute[71347]: </disk>
Apr 14 14:34:44 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:34:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] No VIF found with MAC fa:16:3e:8e:57:4b, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:34:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-944de01a-f6d2-4cdd-8377-65d6cd4ca53a tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.796s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:46 user nova-compute[71347]: INFO nova.compute.manager [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Detaching volume 38d3efe2-64e7-4338-bf17-40c6053527e9
Apr 14 14:34:46 user nova-compute[71347]: INFO nova.virt.block_device [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Attempting to driver detach volume 38d3efe2-64e7-4338-bf17-40c6053527e9 from mountpoint /dev/vdb
Apr 14 14:34:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Attempting to detach device vdb from instance cba499ef-3621-4516-875f-492eef042874 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:34:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:34:46 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:34:46 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:34:46 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:34:46 user nova-compute[71347]:   <serial>38d3efe2-64e7-4338-bf17-40c6053527e9</serial>
Apr 14 14:34:46 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:34:46 user nova-compute[71347]: </disk>
Apr 14 14:34:46 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:34:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully detached device vdb from instance cba499ef-3621-4516-875f-492eef042874 from the persistent domain config.
Apr 14 14:34:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cba499ef-3621-4516-875f-492eef042874 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:34:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:34:46 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:34:46 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:34:46 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:34:46 user nova-compute[71347]:   <serial>38d3efe2-64e7-4338-bf17-40c6053527e9</serial>
Apr 14 14:34:46 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:34:46 user nova-compute[71347]: </disk>
Apr 14 14:34:46 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482887.1685371, cba499ef-3621-4516-875f-492eef042874 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:34:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully detached device vdb from instance cba499ef-3621-4516-875f-492eef042874 from the live domain config.
Apr 14 14:34:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdmWBpOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:34:47 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2778b686-ead4-4170-93cb-72cbbc59a34f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:34:47 user nova-compute[71347]: No targets found.
Apr 14 14:34:47 user nova-compute[71347]: iSNS:
Apr 14 14:34:47 user nova-compute[71347]: No targets found.
Apr 14 14:34:47 user nova-compute[71347]: STATIC:
Apr 14 14:34:47 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1
Apr 14 14:34:47 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:34:47 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:34:47 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9
Apr 14 14:34:47 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:34:47 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:34:47 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9
Apr 14 14:34:47 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:34:47 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:34:47 user nova-compute[71347]: FIRMWARE:
Apr 14 14:34:47 user nova-compute[71347]: No targets found.
Apr 14 14:34:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:34:47 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:34:47 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[18860033-28b6-4588-93a1-2d411dc55bdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cead01e3-e490-4a46-890c-7d36ec3d0355]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:47 user nova-compute[71347]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)
Apr 14 14:34:47 user nova-compute[71347]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)
Apr 14 14:34:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:47 user nova-compute[71347]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 (non-flash)
Apr 14 14:34:47 user nova-compute[71347]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)
Apr 14 14:34:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4b90670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80481b9-0b54-4437-a94f-0082f88e133f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ff6af-5e0e-4292-967f-4ffa963020ad]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bf9db6-7acf-4a15-8e6a-4c49c09da1f3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc7ebe-2a54-4445-aa1c-3720b3d1e653]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07322c6-75da-43ba-b6ad-365a2ea38e2e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b795df4f-017b-4d5c-b925-8d8d3e70a07b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9, portal: 172.16.0.220,3260]
Apr 14 14:34:47 user nova-compute[71347]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9, portal: 172.16.0.220,3260] successful.
Apr 14 14:34:47 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38d3efe2-64e7-4338-bf17-40c6053527e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae92f97-7edc-4ddc-863c-6412c11e38b6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== disconnect_volume: return (359ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:34:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:48 user nova-compute[71347]: INFO nova.compute.manager [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Unshelving
Apr 14 14:34:48 user nova-compute[71347]: INFO nova.virt.block_device [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Booting with volume 1eb54abc-e5f8-4871-b539-2002d1b2a221 at /dev/vda
Apr 14 14:34:48 user nova-compute[71347]: DEBUG nova.objects.instance [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3cc408b0-40c8-45d9-9064-14540c889b37 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.837s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG os_brick.utils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6195917e-f82d-4295-83a5-f89979ab9f41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa3b0a9-917b-4baa-8fde-df383bfc8e6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf18a76-e199-4cbe-9de8-0290915ac310]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2e6616-aafd-4195-b307-ed0a36b51b7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:34:48 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d80f8bd-b5ed-4c61-8f9a-efd95f25f183]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG os_brick.utils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating existing volume attachment record: a3a1a067-4e62-48d1-8f68-7709bdfa6234 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:48 user nova-compute[71347]: INFO nova.compute.manager [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Detaching volume cc9cf91c-7eeb-44f2-807e-8ec378a901f9
Apr 14 14:34:48 user nova-compute[71347]: INFO nova.virt.block_device [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Attempting to driver detach volume cc9cf91c-7eeb-44f2-807e-8ec378a901f9 from mountpoint /dev/vdc
Apr 14 14:34:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Attempting to detach device vdc from instance cba499ef-3621-4516-875f-492eef042874 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:34:48 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:34:48 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:34:48 user nova-compute[71347]:   <target dev="vdc" bus="virtio"/>
Apr 14 14:34:48 user nova-compute[71347]:   <serial>cc9cf91c-7eeb-44f2-807e-8ec378a901f9</serial>
Apr 14 14:34:48 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 14:34:48 user nova-compute[71347]: </disk>
Apr 14 14:34:48 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:34:48 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully detached device vdc from instance cba499ef-3621-4516-875f-492eef042874 from the persistent domain config.
Apr 14 14:34:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cba499ef-3621-4516-875f-492eef042874 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:34:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:34:48 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:34:48 user nova-compute[71347]:   <source dev="/dev/sdd"/>
Apr 14 14:34:48 user nova-compute[71347]:   <target dev="vdc" bus="virtio"/>
Apr 14 14:34:48 user nova-compute[71347]:   <serial>cc9cf91c-7eeb-44f2-807e-8ec378a901f9</serial>
Apr 14 14:34:48 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 14:34:48 user nova-compute[71347]: </disk>
Apr 14 14:34:48 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681482889.3778963, cba499ef-3621-4516-875f-492eef042874 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:34:49 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully detached device vdc from instance cba499ef-3621-4516-875f-492eef042874 from the live domain config.
Apr 14 14:34:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmVKeSDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:34:49 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[182edd35-2d3c-4ea7-9389-13f801ef2c2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:34:49 user nova-compute[71347]: No targets found.
Apr 14 14:34:49 user nova-compute[71347]: iSNS:
Apr 14 14:34:49 user nova-compute[71347]: No targets found.
Apr 14 14:34:49 user nova-compute[71347]: STATIC:
Apr 14 14:34:49 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1
Apr 14 14:34:49 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:34:49 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:34:49 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9
Apr 14 14:34:49 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:34:49 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:34:49 user nova-compute[71347]: FIRMWARE:
Apr 14 14:34:49 user nova-compute[71347]: No targets found.
Apr 14 14:34:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:34:49 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:34:49 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b439090-beb9-4cb2-b27d-214f54dd1fa5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc63364-90b2-4c1c-8a68-1bd0bb9ea3d6]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:49 user nova-compute[71347]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)
Apr 14 14:34:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:49 user nova-compute[71347]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 (non-flash)
Apr 14 14:34:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4effeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a276bb6-c392-4f7d-8fb7-edc45db999be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a187e6-a2bc-4c19-914c-310cc10eef4f]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2703b51a-64c0-4ebf-a7d2-6dfc5363a968]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1963857-ac38-48dc-9a1f-19579225dace]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd16e14-df3e-4b5f-a2c4-16f473f87609]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[009982aa-7b94-404f-8942-5cae3b949086]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9, portal: 172.16.0.220,3260]
Apr 14 14:34:49 user nova-compute[71347]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9, portal: 172.16.0.220,3260] successful.
Apr 14 14:34:49 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9cf91c-7eeb-44f2-807e-8ec378a901f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee6ebd0-1635-4db1-ba5b-9e96fa0c14e1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] <== disconnect_volume: return (301ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:34:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-changed-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Refreshing instance network info cache due to event network-changed-b7a7cf30-86d8-48d3-a117-887a3bdc342b. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] Acquiring lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] Acquired lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG nova.network.neutron [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Refreshing network info cache for port b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:50 user nova-compute[71347]: INFO nova.compute.manager [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Terminating instance
Apr 14 14:34:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG nova.objects.instance [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'flavor' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1bb8fa67-1696-4a48-a939-c47ec804fd67 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.845s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-vif-unplugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] No waiting events found dispatching network-vif-unplugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:34:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-5b672176-d36a-4756-a14f-0f806546c331 req-a4677207-a69b-475a-8f91-189baffcafdc service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-vif-unplugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updated VIF entry in instance network info cache for port b7a7cf30-86d8-48d3-a117-887a3bdc342b. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updating instance_info_cache with network_info: [{"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d1108227-290f-4993-90a5-ade5cb1f9295 req-e9df9ab8-889d-4510-939d-cf9ff5cd0a8d service nova] Releasing lock "refresh_cache-fc7da5e7-7b87-458f-82b1-055664003a85" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:34:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Instance destroyed successfully.
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lazy-loading 'resources' on Instance uuid fc7da5e7-7b87-458f-82b1-055664003a85 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1757826084',display_name='tempest-TestStampPattern-server-1757826084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1757826084',id=27,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVd5d8f1BuBRppDw9HXKQyu3/1iOI3YZuUkyUZmTb2VBMBhBMIyRKqpoaUA5/dZnFrRfFPyALC45bswJQWvC/+I/l7V8YK8+DU0/n020XSkmcHMDH6Po4guzWitPY9ppA==',key_name='tempest-TestStampPattern-594781561',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e043301622414bb492b48f0c6366a2',ramdisk_id='',reservation_id='r-boaldqd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-523457803',owner_user_name='tempest-TestStampPattern-523457803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:30:54Z,user_data=None,user_id='b5bccb6643e84c53ab7f1301bdf0cb97',uuid=fc7da5e7-7b87-458f-82b1-055664003a85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converting VIF {"id": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "address": "fa:16:3e:c4:8c:44", "network": {"id": "0a80e6d9-254b-45d7-9f5c-6c710ab5efeb", "bridge": "br-int", "label": "tempest-TestStampPattern-1085805014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e043301622414bb492b48f0c6366a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7a7cf30-86", "ovs_interfaceid": "b7a7cf30-86d8-48d3-a117-887a3bdc342b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:8c:44,bridge_name='br-int',has_traffic_filtering=True,id=b7a7cf30-86d8-48d3-a117-887a3bdc342b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a7cf30-86') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG os_vif [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:8c:44,bridge_name='br-int',has_traffic_filtering=True,id=b7a7cf30-86d8-48d3-a117-887a3bdc342b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a7cf30-86') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7a7cf30-86, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:34:51 user nova-compute[71347]: INFO os_vif [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:8c:44,bridge_name='br-int',has_traffic_filtering=True,id=b7a7cf30-86d8-48d3-a117-887a3bdc342b,network=Network(0a80e6d9-254b-45d7-9f5c-6c710ab5efeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7a7cf30-86')
Apr 14 14:34:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Deleting instance files /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85_del
Apr 14 14:34:51 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Deletion of /opt/stack/data/nova/instances/fc7da5e7-7b87-458f-82b1-055664003a85_del complete
Apr 14 14:34:51 user nova-compute[71347]: INFO nova.compute.manager [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "cba499ef-3621-4516-875f-492eef042874-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:51 user nova-compute[71347]: INFO nova.compute.manager [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Terminating instance
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received event network-vif-unplugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] Acquiring lock "cba499ef-3621-4516-875f-492eef042874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] Lock "cba499ef-3621-4516-875f-492eef042874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] Lock "cba499ef-3621-4516-875f-492eef042874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] [instance: cba499ef-3621-4516-875f-492eef042874] No waiting events found dispatching network-vif-unplugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:34:51 user nova-compute[71347]: DEBUG nova.compute.manager [req-922f2f92-9d7f-4aab-a9a4-7eadf55478f6 req-e1e937d5-0b85-4db9-9aab-1c60ee3c83ba service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received event network-vif-unplugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:34:52 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Took 0.71 seconds to deallocate network for instance.
Apr 14 14:34:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: cba499ef-3621-4516-875f-492eef042874] Instance destroyed successfully.
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lazy-loading 'resources' on Instance uuid cba499ef-3621-4516-875f-492eef042874 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-53779625',display_name='tempest-AttachVolumeTestJSON-server-53779625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-53779625',id=32,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6nxE5S1wXirRhC6sEEE9KneN1kwn9K9fmRcCO+E3aGgJS7fOW4IODElILe/Gx+GrA+9S/8eA0xwx1qi2r/F+/PatQ9TQz4wa3zRf8GGvnMpfgt6aeLXG9WeRnJTDpeAg==',key_name='tempest-keypair-279292969',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dd9adda27714cf5b55203d8d76de05a',ramdisk_id='',reservation_id='r-wk09jshl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1787222284',owner_user_name='tempest-AttachVolumeTestJSON-1787222284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:32:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='303cb0475ae74f328ee503d1e9d1f652',uuid=cba499ef-3621-4516-875f-492eef042874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converting VIF {"id": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "address": "fa:16:3e:8e:57:4b", "network": {"id": "e74c25a5-d089-40ed-9f3f-6d838da07564", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-766801960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dd9adda27714cf5b55203d8d76de05a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14f10c1f-44", "ovs_interfaceid": "14f10c1f-44c6-4ddb-9dcd-16205410ce60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:57:4b,bridge_name='br-int',has_traffic_filtering=True,id=14f10c1f-44c6-4ddb-9dcd-16205410ce60,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f10c1f-44') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG os_vif [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:57:4b,bridge_name='br-int',has_traffic_filtering=True,id=14f10c1f-44c6-4ddb-9dcd-16205410ce60,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f10c1f-44') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14f10c1f-44, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:34:52 user nova-compute[71347]: INFO os_vif [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:57:4b,bridge_name='br-int',has_traffic_filtering=True,id=14f10c1f-44c6-4ddb-9dcd-16205410ce60,network=Network(e74c25a5-d089-40ed-9f3f-6d838da07564),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14f10c1f-44')
Apr 14 14:34:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Deleting instance files /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874_del
Apr 14 14:34:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Deletion of /opt/stack/data/nova/instances/cba499ef-3621-4516-875f-492eef042874_del complete
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:52 user nova-compute[71347]: INFO nova.compute.manager [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] [instance: cba499ef-3621-4516-875f-492eef042874] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 14:34:52 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: cba499ef-3621-4516-875f-492eef042874] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:34:52 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: cba499ef-3621-4516-875f-492eef042874] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:34:52 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Deleted allocations for instance fc7da5e7-7b87-458f-82b1-055664003a85
Apr 14 14:34:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c9b729b-1290-4126-ace5-ff0f66423a9a tempest-TestStampPattern-523457803 tempest-TestStampPattern-523457803-project-member] Lock "fc7da5e7-7b87-458f-82b1-055664003a85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Acquiring lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] Lock "fc7da5e7-7b87-458f-82b1-055664003a85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] No waiting events found dispatching network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:34:53 user nova-compute[71347]: WARNING nova.compute.manager [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received unexpected event network-vif-plugged-b7a7cf30-86d8-48d3-a117-887a3bdc342b for instance with vm_state deleted and task_state None.
Apr 14 14:34:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-4558f809-b63c-4326-ab6e-23ec3c56b8e1 req-2b93004e-2e85-4f54-998f-2c8859e55d75 service nova] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Received event network-vif-deleted-b7a7cf30-86d8-48d3-a117-887a3bdc342b {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'pci_requests' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'numa_topology' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:34:53 user nova-compute[71347]: INFO nova.compute.claims [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Claim successful on node user
Apr 14 14:34:53 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:34:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received event network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] Acquiring lock "cba499ef-3621-4516-875f-492eef042874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] Lock "cba499ef-3621-4516-875f-492eef042874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] Lock "cba499ef-3621-4516-875f-492eef042874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] No waiting events found dispatching network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:34:54 user nova-compute[71347]: WARNING nova.compute.manager [req-59f6c1a3-6ae1-430c-bef4-352ace16014d req-5bf28a55-298b-4f33-ac2b-bb8b1a44a272 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received unexpected event network-vif-plugged-14f10c1f-44c6-4ddb-9dcd-16205410ce60 for instance with vm_state active and task_state deleting.
Apr 14 14:34:54 user nova-compute[71347]: INFO nova.network.neutron [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating port 1219695c-8de1-4b6b-a558-b7713d98a9a9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: cba499ef-3621-4516-875f-492eef042874] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:34:54 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: cba499ef-3621-4516-875f-492eef042874] Took 1.76 seconds to deallocate network for instance.
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:54 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Deleted allocations for instance cba499ef-3621-4516-875f-492eef042874
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2a1767ce-e282-41f9-beb7-4742ce07b458 tempest-AttachVolumeTestJSON-1787222284 tempest-AttachVolumeTestJSON-1787222284-project-member] Lock "cba499ef-3621-4516-875f-492eef042874" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.019s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquired lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing instance network info cache due to event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:34:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] Acquiring lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Releasing lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:34:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Creating image(s)
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Ensure instance console log exists: /opt/stack/data/nova/instances/ca57f876-a86b-4a47-b941-ea2fd63f1298/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Start _get_guest_xml network_info=[{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UstmfrpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca57f876-a86b-4a47-b941-ea2fd63f1298', 'attached_at': '', 'detached_at': '', 'volume_id': '1eb54abc-e5f8-4871-b539-2002d1b2a221', 'serial': '1eb54abc-e5f8-4871-b539-2002d1b2a221'}, 'attachment_id': 'a3a1a067-4e62-48d1-8f68-7709bdfa6234', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] Acquired lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:34:55 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:34:55 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UstmfrpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:34:55 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:34:55 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:34:55 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cdf6fd-1120-487c-952a-1214140e1ec9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:34:55 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f7f426-08df-4915-bc49-7dd282a5b4b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221] added
Apr 14 14:34:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e808c-c0b6-45c4-98f0-3c19388a8098]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-725804b8-5600-479a-b21d-d756b28d22c7 req-2c794f5f-a269-4782-8c31-40634d62cc22 service nova] [instance: cba499ef-3621-4516-875f-492eef042874] Received event network-vif-deleted-14f10c1f-44c6-4ddb-9dcd-16205410ce60 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[187db169-ec2b-4cdc-81c2-721f3ae596ed]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UstmfrpS {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UstmfrpS" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c146e9c-7a16-4de3-9257-fd0ce3ce2687]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UstmfrpS'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd3e26b-a999-4377-bfa7-f4d3366d246a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd0dd1-35ea-4018-8c9e-a800a7823ea9]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c90f9-6414-453a-bc56-da2e1967f87b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260]
Apr 14 14:34:55 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260] successful.
Apr 14 14:34:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e6d7c8-eade-4aaa-b687-679e1ac0b4b7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7b6241-66a8-44f0-a32f-77028200cf39]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:55 user nova-compute[71347]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:34:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:34:55 user nova-compute[71347]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:34:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[77445853-aba1-47da-bd0b-97a66337515e]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updated VIF entry in instance network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG nova.network.neutron [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:34:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-54a16b7a-b825-4990-a11e-b6b6153c6947 req-2a7e2443-6a25-4c62-af1a-c131cc7567a8 service nova] Releasing lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UstmfrpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23766366363646165', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766366363646165', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-755157756',display_name='tempest-TestShelveInstance-server-755157756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-755157756',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-790180658',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:31:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8137fbeb0b0546eb9fd19b76bb8b6b7a',ramdisk_id='',reservation_id='r-wz0by5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1144252643',owner_user_name='tempest-TestShelveInstance-1144252643-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:34:48Z,user_data=None,user_id='bc2d448f2dfc45498252bab608df3446',uuid=ca57f876-a86b-4a47-b941-ea2fd63f1298,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converting VIF {"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'pci_devices' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:34:56 user nova-compute[71347]:   <uuid>ca57f876-a86b-4a47-b941-ea2fd63f1298</uuid>
Apr 14 14:34:56 user nova-compute[71347]:   <name>instance-0000001d</name>
Apr 14 14:34:56 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:34:56 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:34:56 user nova-compute[71347]:   <metadata>
Apr 14 14:34:56 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:34:56 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:34:56 user nova-compute[71347]:       <nova:name>tempest-TestShelveInstance-server-755157756</nova:name>
Apr 14 14:34:56 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:34:55</nova:creationTime>
Apr 14 14:34:56 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:34:56 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:34:56 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:34:56 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:34:56 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:34:56 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:34:56 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:34:56 user nova-compute[71347]:       <nova:owner>
Apr 14 14:34:56 user nova-compute[71347]:         <nova:user uuid="bc2d448f2dfc45498252bab608df3446">tempest-TestShelveInstance-1144252643-project-member</nova:user>
Apr 14 14:34:56 user nova-compute[71347]:         <nova:project uuid="8137fbeb0b0546eb9fd19b76bb8b6b7a">tempest-TestShelveInstance-1144252643</nova:project>
Apr 14 14:34:56 user nova-compute[71347]:       </nova:owner>
Apr 14 14:34:56 user nova-compute[71347]:       <nova:ports>
Apr 14 14:34:56 user nova-compute[71347]:         <nova:port uuid="1219695c-8de1-4b6b-a558-b7713d98a9a9">
Apr 14 14:34:56 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 14:34:56 user nova-compute[71347]:         </nova:port>
Apr 14 14:34:56 user nova-compute[71347]:       </nova:ports>
Apr 14 14:34:56 user nova-compute[71347]:     </nova:instance>
Apr 14 14:34:56 user nova-compute[71347]:   </metadata>
Apr 14 14:34:56 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:34:56 user nova-compute[71347]:     <system>
Apr 14 14:34:56 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:34:56 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:34:56 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:34:56 user nova-compute[71347]:       <entry name="serial">ca57f876-a86b-4a47-b941-ea2fd63f1298</entry>
Apr 14 14:34:56 user nova-compute[71347]:       <entry name="uuid">ca57f876-a86b-4a47-b941-ea2fd63f1298</entry>
Apr 14 14:34:56 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:34:56 user nova-compute[71347]:     </system>
Apr 14 14:34:56 user nova-compute[71347]:   </sysinfo>
Apr 14 14:34:56 user nova-compute[71347]:   <os>
Apr 14 14:34:56 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:34:56 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:34:56 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:34:56 user nova-compute[71347]:   </os>
Apr 14 14:34:56 user nova-compute[71347]:   <features>
Apr 14 14:34:56 user nova-compute[71347]:     <acpi/>
Apr 14 14:34:56 user nova-compute[71347]:     <apic/>
Apr 14 14:34:56 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:34:56 user nova-compute[71347]:   </features>
Apr 14 14:34:56 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:34:56 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:34:56 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:34:56 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:34:56 user nova-compute[71347]:   </clock>
Apr 14 14:34:56 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:34:56 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:34:56 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:34:56 user nova-compute[71347]:   </cpu>
Apr 14 14:34:56 user nova-compute[71347]:   <devices>
Apr 14 14:34:56 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:34:56 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:34:56 user nova-compute[71347]:       <source dev="/dev/sdc"/>
Apr 14 14:34:56 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:34:56 user nova-compute[71347]:       <serial>1eb54abc-e5f8-4871-b539-2002d1b2a221</serial>
Apr 14 14:34:56 user nova-compute[71347]:     </disk>
Apr 14 14:34:56 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:34:56 user nova-compute[71347]:       <mac address="fa:16:3e:a6:b5:7d"/>
Apr 14 14:34:56 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:34:56 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:34:56 user nova-compute[71347]:       <target dev="tap1219695c-8d"/>
Apr 14 14:34:56 user nova-compute[71347]:     </interface>
Apr 14 14:34:56 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:34:56 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/ca57f876-a86b-4a47-b941-ea2fd63f1298/console.log" append="off"/>
Apr 14 14:34:56 user nova-compute[71347]:     </serial>
Apr 14 14:34:56 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:34:56 user nova-compute[71347]:     <video>
Apr 14 14:34:56 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:34:56 user nova-compute[71347]:     </video>
Apr 14 14:34:56 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:34:56 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:34:56 user nova-compute[71347]:     </rng>
Apr 14 14:34:56 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:34:56 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:34:56 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:34:56 user nova-compute[71347]:     </memballoon>
Apr 14 14:34:56 user nova-compute[71347]:   </devices>
Apr 14 14:34:56 user nova-compute[71347]: </domain>
Apr 14 14:34:56 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-755157756',display_name='tempest-TestShelveInstance-server-755157756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-755157756',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-790180658',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:31:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8137fbeb0b0546eb9fd19b76bb8b6b7a',ramdisk_id='',reservation_id='r-wz0by5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1144252643',owner_user_name='tempest-TestShelveInstance-1144252643-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:34:48Z,user_data=None,user_id='bc2d448f2dfc45498252bab608df3446',uuid=ca57f876-a86b-4a47-b941-ea2fd63f1298,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converting VIF {"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG os_vif [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1219695c-8d, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1219695c-8d, col_values=(('external_ids', {'iface-id': '1219695c-8de1-4b6b-a558-b7713d98a9a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:b5:7d', 'vm-uuid': 'ca57f876-a86b-4a47-b941-ea2fd63f1298'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:56 user nova-compute[71347]: INFO os_vif [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d')
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:34:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] No VIF found with MAC fa:16:3e:a6:b5:7d, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] No waiting events found dispatching network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:34:58 user nova-compute[71347]: WARNING nova.compute.manager [req-cbb17996-9f53-4288-896c-c755d47379f5 req-bd586fce-d5ca-45f0-b835-9446103374cb service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received unexpected event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 14:34:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:34:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482900.3440273, ca57f876-a86b-4a47-b941-ea2fd63f1298 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:35:00 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] VM Resumed (Lifecycle Event)
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:35:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance spawned successfully.
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:35:00 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482900.3452086, ca57f876-a86b-4a47-b941-ea2fd63f1298 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:35:00 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] VM Started (Lifecycle Event)
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c816bcf7-8017-40f9-9725-5e6d15936d8a tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.094s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] No waiting events found dispatching network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:35:00 user nova-compute[71347]: WARNING nova.compute.manager [req-1af2a8c3-d0ed-4b41-9c6c-85a543bc8382 req-ec51ca18-c614-4796-bc32-ae880c1a87f8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received unexpected event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance with vm_state active and task_state None.
Apr 14 14:35:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:03 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:06 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482891.2928789, fc7da5e7-7b87-458f-82b1-055664003a85 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:35:06 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] VM Stopped (Lifecycle Event)
Apr 14 14:35:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0d6fe535-ee75-4ab4-852d-70f3da876086 None None] [instance: fc7da5e7-7b87-458f-82b1-055664003a85] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:07 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482892.316912, cba499ef-3621-4516-875f-492eef042874 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:35:07 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: cba499ef-3621-4516-875f-492eef042874] VM Stopped (Lifecycle Event)
Apr 14 14:35:07 user nova-compute[71347]: DEBUG nova.compute.manager [None req-45923cc2-d2fd-4f16-8c5a-f6573f42fa00 None None] [instance: cba499ef-3621-4516-875f-492eef042874] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:07 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:35:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:10 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:35:11 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:35:11 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8340MB free_disk=26.520252227783203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:35:11 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:35:12 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:35:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 48dc94a3-6933-475b-8803-828acc9d6577 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updating instance_info_cache with network_info: [{"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:35:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-changed-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Refreshing instance network info cache due to event network-changed-a7f26438-6282-4bdb-a730-cddb218c10ce. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] Acquiring lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] Acquired lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:35:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Refreshing network info cache for port a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:35:27 user nova-compute[71347]: DEBUG nova.network.neutron [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updated VIF entry in instance network info cache for port a7f26438-6282-4bdb-a730-cddb218c10ce. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:35:27 user nova-compute[71347]: DEBUG nova.network.neutron [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updating instance_info_cache with network_info: [{"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:35:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2e701462-01f4-43a0-bc75-0488b7b72216 req-d57663c4-82b6-4499-9140-83a9b5aceb11 service nova] Releasing lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Stashing vm_state: active {{(pid=71347) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_requests' on Instance uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:35:28 user nova-compute[71347]: INFO nova.compute.claims [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Claim successful on node user
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'resources' on Instance uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:35:28 user nova-compute[71347]: INFO nova.compute.resource_tracker [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating resource usage from migration 918ec7bf-8a64-4223-aeab-b13e73a3a0da
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.324s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:28 user nova-compute[71347]: INFO nova.compute.manager [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Migrating
Apr 14 14:35:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-changed-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Refreshing instance network info cache due to event network-changed-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:35:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Acquiring lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:35:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:35:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:35:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Acquired lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:35:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Refreshing network info cache for port 749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:35:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Starting migrate_disk_and_power_off {{(pid=71347) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 14:35:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-unplugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.compute.manager [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] No waiting events found dispatching network-vif-unplugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:35:30 user nova-compute[71347]: WARNING nova.compute.manager [req-5b01f4ef-c40b-4845-bd89-a0b72e3cc388 req-a33eb818-ba29-4b1b-80b8-feb3446d029d service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received unexpected event network-vif-unplugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance with vm_state active and task_state resize_migrating.
Apr 14 14:35:30 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance destroyed successfully.
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842987954',display_name='tempest-ServerActionsTestJSON-server-1842987954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842987954',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-85xknzdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=6d350d39-ba90-4e7f-8f95-bf565f787b0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:22:07:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:22:07:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_vif [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap749a0a24-f4, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:35:30 user nova-compute[71347]: INFO os_vif [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4')
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSVlLBgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:35:30 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed3a506-54e6-4d33-85da-03da5331d618]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:35:30 user nova-compute[71347]: No targets found.
Apr 14 14:35:30 user nova-compute[71347]: iSNS:
Apr 14 14:35:30 user nova-compute[71347]: No targets found.
Apr 14 14:35:30 user nova-compute[71347]: STATIC:
Apr 14 14:35:30 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1
Apr 14 14:35:30 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:35:30 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:35:30 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221
Apr 14 14:35:30 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:35:30 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:35:30 user nova-compute[71347]: FIRMWARE:
Apr 14 14:35:30 user nova-compute[71347]: No targets found.
Apr 14 14:35:30 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:35:30 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:35:30 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.network.neutron [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updated VIF entry in instance network info cache for port 749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.network.neutron [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2651f99-37d9-406c-9ba4-ad287c3bf068 req-c43ec63a-75d0-415e-8013-4d6c98cf4827 service nova] Releasing lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f485ae-8a2d-4525-9511-0b94795fdda3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[878f8605-3369-4bbf-919b-7da7a7e5c5bb]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:35:30 user nova-compute[71347]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:35:30 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:35:30 user nova-compute[71347]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:35:30 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4db3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f61fe-6bba-4894-9c09-2c5cbade1f89]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9db8c2-2939-4102-bc37-90d633d5876c]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d05b4a-5ef3-44e2-80d6-d3ab75bc953b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c4cf30-f468-43fa-9529-8cf86b24dc74]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[69648ccd-e05c-476b-8f5f-29c8976e4c64]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96af7c4-254b-4f8e-84b4-b5d119d29abe]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260]
Apr 14 14:35:30 user nova-compute[71347]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260] successful.
Apr 14 14:35:30 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe733627-7189-4e08-8088-b9e086af3743]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== disconnect_volume: return (347ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:35:30 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:35:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Port 749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 binding to destination host user is already ACTIVE {{(pid=71347) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG nova.compute.manager [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] No waiting events found dispatching network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:35:32 user nova-compute[71347]: WARNING nova.compute.manager [req-5112d3ac-4a06-4b9c-85f9-9ca4d73ac22a req-9b514a47-0bf3-4554-8223-ae30a29aba05 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received unexpected event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance with vm_state active and task_state resize_migrated.
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG nova.network.neutron [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG os_brick.utils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[94757cb3-592a-49c3-b64f-2f95a504295f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a035751-d62e-4a68-9f10-2895ef830be5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f8144c-924d-411e-ae5e-083cddeb244b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[52597ae0-1f81-4eae-b47a-611c391d6f8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:35:32 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:35:33 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:35:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd7b03d-5097-4ec0-8262-8833e6f42d33]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:35:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:35:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:35:33 user nova-compute[71347]: DEBUG os_brick.utils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:35:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Starting finish_migration {{(pid=71347) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance directory exists: not creating {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 14:35:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Creating image(s)
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Ensure instance console log exists: /opt/stack/data/nova/instances/6d350d39-ba90-4e7f-8f95-bf565f787b0a/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Start _get_guest_xml network_info=[{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:22:07:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSVlLBgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6d350d39-ba90-4e7f-8f95-bf565f787b0a', 'attached_at': '2023-04-14T14:35:38.000000', 'detached_at': '', 'volume_id': '9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'serial': '9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1'}, 'attachment_id': 'f1a1d3e1-b5b7-4e83-ba84-c604f8faf7a8', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:35:38 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:35:38 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSVlLBgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:35:38 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:35:38 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:35:38 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc3efdf-1ff1-4e98-861a-14696432c3d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:35:38 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee52cc76-8f09-43b1-b89b-1ec189540b16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1] added
Apr 14 14:35:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[26840922-845d-4eee-8352-459cb64750de]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167d646-32ca-4cea-98f3-ff3f21f8f194]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSVlLBgT {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSVlLBgT" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[54784f27-1801-4983-9438-b069dec21357]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WSVlLBgT'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[272c0966-b302-42f3-ba5d-6d4de78e5e17]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[32247d0e-611a-418f-8a29-94c89a8de4e1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:35:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:35:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[317db34a-eed4-41a6-9b01-305864312aac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260]
Apr 14 14:35:38 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260] successful.
Apr 14 14:35:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75795f1-f70e-4aec-a44a-20377bb60e2b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd451faf-5a40-4416-9261-0fa63826ac24]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:35:38 user nova-compute[71347]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:35:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:35:38 user nova-compute[71347]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:35:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc38f7-0417-4555-9fce-14daeb866951]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:35:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSVlLBgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23835663565393264', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835663565393264', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842987954',display_name='tempest-ServerActionsTestJSON-server-1842987954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842987954',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-85xknzdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:35:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=6d350d39-ba90-4e7f-8f95-bf565f787b0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:22:07:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:22:07:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:35:39 user nova-compute[71347]:   <uuid>6d350d39-ba90-4e7f-8f95-bf565f787b0a</uuid>
Apr 14 14:35:39 user nova-compute[71347]:   <name>instance-00000021</name>
Apr 14 14:35:39 user nova-compute[71347]:   <memory>196608</memory>
Apr 14 14:35:39 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:35:39 user nova-compute[71347]:   <metadata>
Apr 14 14:35:39 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:35:39 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:35:39 user nova-compute[71347]:       <nova:name>tempest-ServerActionsTestJSON-server-1842987954</nova:name>
Apr 14 14:35:39 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:35:38</nova:creationTime>
Apr 14 14:35:39 user nova-compute[71347]:       <nova:flavor name="m1.micro">
Apr 14 14:35:39 user nova-compute[71347]:         <nova:memory>192</nova:memory>
Apr 14 14:35:39 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:35:39 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:35:39 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:35:39 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:35:39 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:35:39 user nova-compute[71347]:       <nova:owner>
Apr 14 14:35:39 user nova-compute[71347]:         <nova:user uuid="797d2d1bff8e4b26afe7856e4c3877cf">tempest-ServerActionsTestJSON-932644409-project-member</nova:user>
Apr 14 14:35:39 user nova-compute[71347]:         <nova:project uuid="3b087f26a80045f3844873220a67a4e4">tempest-ServerActionsTestJSON-932644409</nova:project>
Apr 14 14:35:39 user nova-compute[71347]:       </nova:owner>
Apr 14 14:35:39 user nova-compute[71347]:       <nova:ports>
Apr 14 14:35:39 user nova-compute[71347]:         <nova:port uuid="749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1">
Apr 14 14:35:39 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 14:35:39 user nova-compute[71347]:         </nova:port>
Apr 14 14:35:39 user nova-compute[71347]:       </nova:ports>
Apr 14 14:35:39 user nova-compute[71347]:     </nova:instance>
Apr 14 14:35:39 user nova-compute[71347]:   </metadata>
Apr 14 14:35:39 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:35:39 user nova-compute[71347]:     <system>
Apr 14 14:35:39 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:35:39 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:35:39 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:35:39 user nova-compute[71347]:       <entry name="serial">6d350d39-ba90-4e7f-8f95-bf565f787b0a</entry>
Apr 14 14:35:39 user nova-compute[71347]:       <entry name="uuid">6d350d39-ba90-4e7f-8f95-bf565f787b0a</entry>
Apr 14 14:35:39 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:35:39 user nova-compute[71347]:     </system>
Apr 14 14:35:39 user nova-compute[71347]:   </sysinfo>
Apr 14 14:35:39 user nova-compute[71347]:   <os>
Apr 14 14:35:39 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:35:39 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:35:39 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:35:39 user nova-compute[71347]:   </os>
Apr 14 14:35:39 user nova-compute[71347]:   <features>
Apr 14 14:35:39 user nova-compute[71347]:     <acpi/>
Apr 14 14:35:39 user nova-compute[71347]:     <apic/>
Apr 14 14:35:39 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:35:39 user nova-compute[71347]:   </features>
Apr 14 14:35:39 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:35:39 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:35:39 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:35:39 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:35:39 user nova-compute[71347]:   </clock>
Apr 14 14:35:39 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:35:39 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:35:39 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:35:39 user nova-compute[71347]:   </cpu>
Apr 14 14:35:39 user nova-compute[71347]:   <devices>
Apr 14 14:35:39 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:35:39 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:35:39 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:35:39 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:35:39 user nova-compute[71347]:       <serial>9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1</serial>
Apr 14 14:35:39 user nova-compute[71347]:     </disk>
Apr 14 14:35:39 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:35:39 user nova-compute[71347]:       <mac address="fa:16:3e:22:07:00"/>
Apr 14 14:35:39 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:35:39 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:35:39 user nova-compute[71347]:       <target dev="tap749a0a24-f4"/>
Apr 14 14:35:39 user nova-compute[71347]:     </interface>
Apr 14 14:35:39 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:35:39 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/6d350d39-ba90-4e7f-8f95-bf565f787b0a/console.log" append="off"/>
Apr 14 14:35:39 user nova-compute[71347]:     </serial>
Apr 14 14:35:39 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:35:39 user nova-compute[71347]:     <video>
Apr 14 14:35:39 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:35:39 user nova-compute[71347]:     </video>
Apr 14 14:35:39 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:35:39 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:35:39 user nova-compute[71347]:     </rng>
Apr 14 14:35:39 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:35:39 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:35:39 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:35:39 user nova-compute[71347]:     </memballoon>
Apr 14 14:35:39 user nova-compute[71347]:   </devices>
Apr 14 14:35:39 user nova-compute[71347]: </domain>
Apr 14 14:35:39 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842987954',display_name='tempest-ServerActionsTestJSON-server-1842987954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842987954',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:33:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-85xknzdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:35:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=6d350d39-ba90-4e7f-8f95-bf565f787b0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:22:07:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-2021374269-network", "vif_mac": "fa:16:3e:22:07:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG os_vif [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap749a0a24-f4, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap749a0a24-f4, col_values=(('external_ids', {'iface-id': '749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:07:00', 'vm-uuid': '6d350d39-ba90-4e7f-8f95-bf565f787b0a'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:39 user nova-compute[71347]: INFO os_vif [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4')
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:35:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] No VIF found with MAC fa:16:3e:22:07:00, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] No waiting events found dispatching network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:35:41 user nova-compute[71347]: WARNING nova.compute.manager [req-12a6d97f-5299-4030-986f-2dd4357b6b6d req-e6ea628a-96ac-45a0-83a9-8b0826c073c8 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received unexpected event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance with vm_state active and task_state resize_finish.
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 6d350d39-ba90-4e7f-8f95-bf565f787b0a due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482943.256018, 6d350d39-ba90-4e7f-8f95-bf565f787b0a => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:35:43 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] VM Resumed (Lifecycle Event)
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:35:43 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance running successfully.
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Failed to set time: agent not configured {{(pid=71347) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-ee03856e-9476-431b-96fa-5725834bd28d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] finish_migration finished successfully. {{(pid=71347) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:35:43 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482943.2614317, 6d350d39-ba90-4e7f-8f95-bf565f787b0a => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:35:43 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] VM Started (Lifecycle Event)
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:35:43 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] No waiting events found dispatching network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:35:43 user nova-compute[71347]: WARNING nova.compute.manager [req-5ce5cf1c-1d57-4067-b201-827af0963c2f req-86f6e41a-29dc-4650-b1a8-32f90de8fe04 service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received unexpected event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance with vm_state active and task_state resize_finish.
Apr 14 14:35:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:35:47 user nova-compute[71347]: INFO nova.compute.claims [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Claim successful on node user
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:35:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:35:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Creating image(s)
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "/opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "/opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk 1073741824" returned: 0 in 0.065s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Cannot resize image /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lazy-loading 'migration_context' on Instance uuid b8cf95c3-035b-461a-9b48-c485734bfca9 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Ensure instance console log exists: /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:48 user nova-compute[71347]: DEBUG nova.policy [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebf7adeca29b487dba8146ad46a1ef4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a000f56a044c08ae1f9192a95c8f4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:35:49 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Successfully created port: 33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:35:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Successfully updated port: 33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "refresh_cache-b8cf95c3-035b-461a-9b48-c485734bfca9" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquired lock "refresh_cache-b8cf95c3-035b-461a-9b48-c485734bfca9" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-changed-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Refreshing instance network info cache due to event network-changed-33a88d60-7285-4677-a2c8-69200948dd4c. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] Acquiring lock "refresh_cache-b8cf95c3-035b-461a-9b48-c485734bfca9" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Updating instance_info_cache with network_info: [{"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Releasing lock "refresh_cache-b8cf95c3-035b-461a-9b48-c485734bfca9" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Instance network_info: |[{"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] Acquired lock "refresh_cache-b8cf95c3-035b-461a-9b48-c485734bfca9" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.network.neutron [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Refreshing network info cache for port 33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Start _get_guest_xml network_info=[{"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:35:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:35:50 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:35:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2038037319',display_name='tempest-VolumesNegativeTest-instance-2038037319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2038037319',id=34,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a000f56a044c08ae1f9192a95c8f4a',ramdisk_id='',reservation_id='r-lyhe1tby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1698798704',owner_user_name='tempest-VolumesNegativeTest-1698798704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:35:48Z,user_data=None,user_id='ebf7adeca29b487dba8146ad46a1ef4f',uuid=b8cf95c3-035b-461a-9b48-c485734bfca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Converting VIF {"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:71,bridge_name='br-int',has_traffic_filtering=True,id=33a88d60-7285-4677-a2c8-69200948dd4c,network=Network(44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a88d60-72') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lazy-loading 'pci_devices' on Instance uuid b8cf95c3-035b-461a-9b48-c485734bfca9 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:35:51 user nova-compute[71347]:   <uuid>b8cf95c3-035b-461a-9b48-c485734bfca9</uuid>
Apr 14 14:35:51 user nova-compute[71347]:   <name>instance-00000022</name>
Apr 14 14:35:51 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:35:51 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:35:51 user nova-compute[71347]:   <metadata>
Apr 14 14:35:51 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:35:51 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:35:51 user nova-compute[71347]:       <nova:name>tempest-VolumesNegativeTest-instance-2038037319</nova:name>
Apr 14 14:35:51 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:35:50</nova:creationTime>
Apr 14 14:35:51 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:35:51 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:35:51 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:35:51 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:35:51 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:35:51 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:35:51 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:35:51 user nova-compute[71347]:       <nova:owner>
Apr 14 14:35:51 user nova-compute[71347]:         <nova:user uuid="ebf7adeca29b487dba8146ad46a1ef4f">tempest-VolumesNegativeTest-1698798704-project-member</nova:user>
Apr 14 14:35:51 user nova-compute[71347]:         <nova:project uuid="e6a000f56a044c08ae1f9192a95c8f4a">tempest-VolumesNegativeTest-1698798704</nova:project>
Apr 14 14:35:51 user nova-compute[71347]:       </nova:owner>
Apr 14 14:35:51 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:35:51 user nova-compute[71347]:       <nova:ports>
Apr 14 14:35:51 user nova-compute[71347]:         <nova:port uuid="33a88d60-7285-4677-a2c8-69200948dd4c">
Apr 14 14:35:51 user nova-compute[71347]:           <nova:ip type="fixed" address="192.168.233.187" ipVersion="4"/>
Apr 14 14:35:51 user nova-compute[71347]:         </nova:port>
Apr 14 14:35:51 user nova-compute[71347]:       </nova:ports>
Apr 14 14:35:51 user nova-compute[71347]:     </nova:instance>
Apr 14 14:35:51 user nova-compute[71347]:   </metadata>
Apr 14 14:35:51 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:35:51 user nova-compute[71347]:     <system>
Apr 14 14:35:51 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:35:51 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:35:51 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:35:51 user nova-compute[71347]:       <entry name="serial">b8cf95c3-035b-461a-9b48-c485734bfca9</entry>
Apr 14 14:35:51 user nova-compute[71347]:       <entry name="uuid">b8cf95c3-035b-461a-9b48-c485734bfca9</entry>
Apr 14 14:35:51 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:35:51 user nova-compute[71347]:     </system>
Apr 14 14:35:51 user nova-compute[71347]:   </sysinfo>
Apr 14 14:35:51 user nova-compute[71347]:   <os>
Apr 14 14:35:51 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:35:51 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:35:51 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:35:51 user nova-compute[71347]:   </os>
Apr 14 14:35:51 user nova-compute[71347]:   <features>
Apr 14 14:35:51 user nova-compute[71347]:     <acpi/>
Apr 14 14:35:51 user nova-compute[71347]:     <apic/>
Apr 14 14:35:51 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:35:51 user nova-compute[71347]:   </features>
Apr 14 14:35:51 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:35:51 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:35:51 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:35:51 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:35:51 user nova-compute[71347]:   </clock>
Apr 14 14:35:51 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:35:51 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:35:51 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:35:51 user nova-compute[71347]:   </cpu>
Apr 14 14:35:51 user nova-compute[71347]:   <devices>
Apr 14 14:35:51 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:35:51 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:35:51 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk"/>
Apr 14 14:35:51 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:35:51 user nova-compute[71347]:     </disk>
Apr 14 14:35:51 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:35:51 user nova-compute[71347]:       <mac address="fa:16:3e:05:00:71"/>
Apr 14 14:35:51 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:35:51 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:35:51 user nova-compute[71347]:       <target dev="tap33a88d60-72"/>
Apr 14 14:35:51 user nova-compute[71347]:     </interface>
Apr 14 14:35:51 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:35:51 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/console.log" append="off"/>
Apr 14 14:35:51 user nova-compute[71347]:     </serial>
Apr 14 14:35:51 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:35:51 user nova-compute[71347]:     <video>
Apr 14 14:35:51 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:35:51 user nova-compute[71347]:     </video>
Apr 14 14:35:51 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:35:51 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:35:51 user nova-compute[71347]:     </rng>
Apr 14 14:35:51 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:35:51 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:35:51 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:35:51 user nova-compute[71347]:     </memballoon>
Apr 14 14:35:51 user nova-compute[71347]:   </devices>
Apr 14 14:35:51 user nova-compute[71347]: </domain>
Apr 14 14:35:51 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2038037319',display_name='tempest-VolumesNegativeTest-instance-2038037319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2038037319',id=34,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a000f56a044c08ae1f9192a95c8f4a',ramdisk_id='',reservation_id='r-lyhe1tby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1698798704',owner_user_name='tempest-VolumesNegativeTest-1698798704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:35:48Z,user_data=None,user_id='ebf7adeca29b487dba8146ad46a1ef4f',uuid=b8cf95c3-035b-461a-9b48-c485734bfca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Converting VIF {"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:71,bridge_name='br-int',has_traffic_filtering=True,id=33a88d60-7285-4677-a2c8-69200948dd4c,network=Network(44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a88d60-72') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG os_vif [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:71,bridge_name='br-int',has_traffic_filtering=True,id=33a88d60-7285-4677-a2c8-69200948dd4c,network=Network(44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a88d60-72') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33a88d60-72, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33a88d60-72, col_values=(('external_ids', {'iface-id': '33a88d60-7285-4677-a2c8-69200948dd4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:00:71', 'vm-uuid': 'b8cf95c3-035b-461a-9b48-c485734bfca9'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:51 user nova-compute[71347]: INFO os_vif [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:71,bridge_name='br-int',has_traffic_filtering=True,id=33a88d60-7285-4677-a2c8-69200948dd4c,network=Network(44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a88d60-72')
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] No VIF found with MAC fa:16:3e:05:00:71, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Updated VIF entry in instance network info cache for port 33a88d60-7285-4677-a2c8-69200948dd4c. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG nova.network.neutron [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Updating instance_info_cache with network_info: [{"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:35:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b0de8432-5e22-4fe7-9413-cc4011c52a44 req-95ff387c-c79b-4546-b672-876531e008d0 service nova] Releasing lock "refresh_cache-b8cf95c3-035b-461a-9b48-c485734bfca9" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:35:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] No waiting events found dispatching network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:35:53 user nova-compute[71347]: WARNING nova.compute.manager [req-16a0fc52-4c40-4b21-89f2-6852d6bff6bb req-8f651aca-1ec6-4e00-b436-2de8929bd5b2 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received unexpected event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c for instance with vm_state building and task_state spawning.
Apr 14 14:35:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482954.9221857, b8cf95c3-035b-461a-9b48-c485734bfca9 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:35:54 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] VM Resumed (Lifecycle Event)
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:35:54 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Instance spawned successfully.
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:35:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:35:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:35:55 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482954.922726, b8cf95c3-035b-461a-9b48-c485734bfca9 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:35:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] VM Started (Lifecycle Event)
Apr 14 14:35:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:35:55 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:35:55 user nova-compute[71347]: INFO nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Took 7.30 seconds to spawn the instance on the hypervisor.
Apr 14 14:35:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:35:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:35:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:35:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:35:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] No waiting events found dispatching network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:35:55 user nova-compute[71347]: WARNING nova.compute.manager [req-c9f271a3-d5f7-4b54-b77c-c279a965694e req-d152b951-4251-4825-a35d-8d85eedc7a9d service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received unexpected event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c for instance with vm_state building and task_state spawning.
Apr 14 14:35:55 user nova-compute[71347]: INFO nova.compute.manager [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Took 8.02 seconds to build instance.
Apr 14 14:35:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c45c25bd-b12a-4d05-a785-2a6d2e6ee4b9 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.115s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:35:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:35:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:07 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:36:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:36:12 user nova-compute[71347]: INFO nova.compute.claims [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Claim successful on node user
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:12 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:36:13 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:36:13 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8275MB free_disk=26.476356506347656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.026s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:36:13 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Applying migration context for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a as it has an incoming, in-progress migration 918ec7bf-8a64-4223-aeab-b13e73a3a0da. Migration status is finished {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 14:36:13 user nova-compute[71347]: INFO nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating resource usage from migration 918ec7bf-8a64-4223-aeab-b13e73a3a0da
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Migration 918ec7bf-8a64-4223-aeab-b13e73a3a0da is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance b8cf95c3-035b-461a-9b48-c485734bfca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 88f2170a-239e-45bd-8864-58285cdb391f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:36:13 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Creating image(s)
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "/opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "/opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "/opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.167s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk 1073741824" returned: 0 in 0.052s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.policy [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '506ec17dec9149698ca687d2ce256acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab35b3694734461828bb8bd19f4bc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.128s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Cannot resize image /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:36:13 user nova-compute[71347]: DEBUG nova.objects.instance [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'migration_context' on Instance uuid 88f2170a-239e-45bd-8864-58285cdb391f {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Ensure instance console log exists: /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Successfully created port: f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:36:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Successfully updated port: f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "refresh_cache-88f2170a-239e-45bd-8864-58285cdb391f" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquired lock "refresh_cache-88f2170a-239e-45bd-8864-58285cdb391f" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received event network-changed-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Refreshing instance network info cache due to event network-changed-f22cb4d2-f783-4b93-b220-44ac1d92d8d2. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] Acquiring lock "refresh_cache-88f2170a-239e-45bd-8864-58285cdb391f" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Updating instance_info_cache with network_info: [{"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Releasing lock "refresh_cache-88f2170a-239e-45bd-8864-58285cdb391f" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Instance network_info: |[{"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] Acquired lock "refresh_cache-88f2170a-239e-45bd-8864-58285cdb391f" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Refreshing network info cache for port f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Start _get_guest_xml network_info=[{"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:36:15 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:36:15 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-352344162',display_name='tempest-VolumesSnapshotTestJSON-instance-352344162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-352344162',id=35,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fab35b3694734461828bb8bd19f4bc65',ramdisk_id='',reservation_id='r-ixftbgyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1438289684',owner_user_name='tempest-VolumesSnapshotTestJSON-1438289684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:36:13Z,user_data=None,user_id='506ec17dec9149698ca687d2ce256acd',uuid=88f2170a-239e-45bd-8864-58285cdb391f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converting VIF {"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:f3:73,bridge_name='br-int',has_traffic_filtering=True,id=f22cb4d2-f783-4b93-b220-44ac1d92d8d2,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22cb4d2-f7') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.objects.instance [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'pci_devices' on Instance uuid 88f2170a-239e-45bd-8864-58285cdb391f {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:36:15 user nova-compute[71347]:   <uuid>88f2170a-239e-45bd-8864-58285cdb391f</uuid>
Apr 14 14:36:15 user nova-compute[71347]:   <name>instance-00000023</name>
Apr 14 14:36:15 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:36:15 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:36:15 user nova-compute[71347]:   <metadata>
Apr 14 14:36:15 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:36:15 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:36:15 user nova-compute[71347]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-352344162</nova:name>
Apr 14 14:36:15 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:36:15</nova:creationTime>
Apr 14 14:36:15 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:36:15 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:36:15 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:36:15 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:36:15 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:36:15 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:36:15 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:36:15 user nova-compute[71347]:       <nova:owner>
Apr 14 14:36:15 user nova-compute[71347]:         <nova:user uuid="506ec17dec9149698ca687d2ce256acd">tempest-VolumesSnapshotTestJSON-1438289684-project-member</nova:user>
Apr 14 14:36:15 user nova-compute[71347]:         <nova:project uuid="fab35b3694734461828bb8bd19f4bc65">tempest-VolumesSnapshotTestJSON-1438289684</nova:project>
Apr 14 14:36:15 user nova-compute[71347]:       </nova:owner>
Apr 14 14:36:15 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:36:15 user nova-compute[71347]:       <nova:ports>
Apr 14 14:36:15 user nova-compute[71347]:         <nova:port uuid="f22cb4d2-f783-4b93-b220-44ac1d92d8d2">
Apr 14 14:36:15 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 14:36:15 user nova-compute[71347]:         </nova:port>
Apr 14 14:36:15 user nova-compute[71347]:       </nova:ports>
Apr 14 14:36:15 user nova-compute[71347]:     </nova:instance>
Apr 14 14:36:15 user nova-compute[71347]:   </metadata>
Apr 14 14:36:15 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:36:15 user nova-compute[71347]:     <system>
Apr 14 14:36:15 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:36:15 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:36:15 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:36:15 user nova-compute[71347]:       <entry name="serial">88f2170a-239e-45bd-8864-58285cdb391f</entry>
Apr 14 14:36:15 user nova-compute[71347]:       <entry name="uuid">88f2170a-239e-45bd-8864-58285cdb391f</entry>
Apr 14 14:36:15 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:36:15 user nova-compute[71347]:     </system>
Apr 14 14:36:15 user nova-compute[71347]:   </sysinfo>
Apr 14 14:36:15 user nova-compute[71347]:   <os>
Apr 14 14:36:15 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:36:15 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:36:15 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:36:15 user nova-compute[71347]:   </os>
Apr 14 14:36:15 user nova-compute[71347]:   <features>
Apr 14 14:36:15 user nova-compute[71347]:     <acpi/>
Apr 14 14:36:15 user nova-compute[71347]:     <apic/>
Apr 14 14:36:15 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:36:15 user nova-compute[71347]:   </features>
Apr 14 14:36:15 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:36:15 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:36:15 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:36:15 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:36:15 user nova-compute[71347]:   </clock>
Apr 14 14:36:15 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:36:15 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:36:15 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:36:15 user nova-compute[71347]:   </cpu>
Apr 14 14:36:15 user nova-compute[71347]:   <devices>
Apr 14 14:36:15 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:36:15 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:36:15 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk"/>
Apr 14 14:36:15 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:36:15 user nova-compute[71347]:     </disk>
Apr 14 14:36:15 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:36:15 user nova-compute[71347]:       <mac address="fa:16:3e:af:f3:73"/>
Apr 14 14:36:15 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:36:15 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:36:15 user nova-compute[71347]:       <target dev="tapf22cb4d2-f7"/>
Apr 14 14:36:15 user nova-compute[71347]:     </interface>
Apr 14 14:36:15 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:36:15 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/console.log" append="off"/>
Apr 14 14:36:15 user nova-compute[71347]:     </serial>
Apr 14 14:36:15 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:36:15 user nova-compute[71347]:     <video>
Apr 14 14:36:15 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:36:15 user nova-compute[71347]:     </video>
Apr 14 14:36:15 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:36:15 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:36:15 user nova-compute[71347]:     </rng>
Apr 14 14:36:15 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:36:15 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:36:15 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:36:15 user nova-compute[71347]:     </memballoon>
Apr 14 14:36:15 user nova-compute[71347]:   </devices>
Apr 14 14:36:15 user nova-compute[71347]: </domain>
Apr 14 14:36:15 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-352344162',display_name='tempest-VolumesSnapshotTestJSON-instance-352344162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-352344162',id=35,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fab35b3694734461828bb8bd19f4bc65',ramdisk_id='',reservation_id='r-ixftbgyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1438289684',owner_user_name='tempest-VolumesSnapshotTestJSON-1438289684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:36:13Z,user_data=None,user_id='506ec17dec9149698ca687d2ce256acd',uuid=88f2170a-239e-45bd-8864-58285cdb391f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converting VIF {"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:f3:73,bridge_name='br-int',has_traffic_filtering=True,id=f22cb4d2-f783-4b93-b220-44ac1d92d8d2,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22cb4d2-f7') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG os_vif [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:f3:73,bridge_name='br-int',has_traffic_filtering=True,id=f22cb4d2-f783-4b93-b220-44ac1d92d8d2,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22cb4d2-f7') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf22cb4d2-f7, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf22cb4d2-f7, col_values=(('external_ids', {'iface-id': 'f22cb4d2-f783-4b93-b220-44ac1d92d8d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:f3:73', 'vm-uuid': '88f2170a-239e-45bd-8864-58285cdb391f'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:15 user nova-compute[71347]: INFO os_vif [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:f3:73,bridge_name='br-int',has_traffic_filtering=True,id=f22cb4d2-f783-4b93-b220-44ac1d92d8d2,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22cb4d2-f7')
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No VIF found with MAC fa:16:3e:af:f3:73, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Updated VIF entry in instance network info cache for port f22cb4d2-f783-4b93-b220-44ac1d92d8d2. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Updating instance_info_cache with network_info: [{"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:36:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4e00c3e1-8b4e-44db-bef4-1fc38332dfb1 req-7a3af964-d77d-425f-a287-2628f075df42 service nova] Releasing lock "refresh_cache-88f2170a-239e-45bd-8864-58285cdb391f" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:36:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:17 user nova-compute[71347]: DEBUG nova.compute.manager [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received event network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:36:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:17 user nova-compute[71347]: DEBUG nova.compute.manager [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] No waiting events found dispatching network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:36:17 user nova-compute[71347]: WARNING nova.compute.manager [req-456a7641-36b5-4572-9a90-18f9a165be8b req-cfa026df-69d3-43a3-b180-21d63b4f0bc1 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received unexpected event network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance with vm_state building and task_state spawning.
Apr 14 14:36:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482979.1513882, 88f2170a-239e-45bd-8864-58285cdb391f => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:36:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] VM Resumed (Lifecycle Event)
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:36:19 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Instance spawned successfully.
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:36:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681482979.155045, 88f2170a-239e-45bd-8864-58285cdb391f => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:36:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] VM Started (Lifecycle Event)
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received event network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] No waiting events found dispatching network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:36:19 user nova-compute[71347]: WARNING nova.compute.manager [req-2a3d4ea6-5069-4935-8b6e-f70dcfd71511 req-152ba771-b65e-4635-afaa-bf70570c54ba service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received unexpected event network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance with vm_state building and task_state spawning.
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:36:19 user nova-compute[71347]: INFO nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Took 5.91 seconds to spawn the instance on the hypervisor.
Apr 14 14:36:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:36:19 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:36:19 user nova-compute[71347]: INFO nova.compute.manager [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Took 7.03 seconds to build instance.
Apr 14 14:36:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-09173d4e-a811-40de-9690-c223782507e5 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.132s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:30 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing instance network info cache due to event network-changed-1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] Acquiring lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] Acquired lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Refreshing network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:39 user nova-compute[71347]: INFO nova.compute.manager [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Terminating instance
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updated VIF entry in instance network info cache for port 1219695c-8de1-4b6b-a558-b7713d98a9a9. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [{"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bb4b4121-009c-4249-ab3e-7f8adba63603 req-efa79a03-8537-4a9b-8a8b-9fec9462556f service nova] Releasing lock "refresh_cache-ca57f876-a86b-4a47-b941-ea2fd63f1298" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:36:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Instance destroyed successfully.
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lazy-loading 'resources' on Instance uuid ca57f876-a86b-4a47-b941-ea2fd63f1298 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T14:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-755157756',display_name='tempest-TestShelveInstance-server-755157756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-755157756',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKJoKJ0C1gwmcl9WN0481R6riIzUurMmeNe4HFPJSFtnAOso9CjS53uyvJdMv1WXI2soZXZFuXATdLz+HY8o19OMrATVnZBHoN6oICfZYn1/7aJe4UeWOor3ZtbYKjF6A==',key_name='tempest-TestShelveInstance-790180658',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:35:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8137fbeb0b0546eb9fd19b76bb8b6b7a',ramdisk_id='',reservation_id='r-wz0by5ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1144252643',owner_user_name='tempest-TestShelveInstance-1144252643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:35:00Z,user_data=None,user_id='bc2d448f2dfc45498252bab608df3446',uuid=ca57f876-a86b-4a47-b941-ea2fd63f1298,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converting VIF {"id": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "address": "fa:16:3e:a6:b5:7d", "network": {"id": "1a30ed81-1d33-4eaa-95de-182342a5a2d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1989992275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8137fbeb0b0546eb9fd19b76bb8b6b7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219695c-8d", "ovs_interfaceid": "1219695c-8de1-4b6b-a558-b7713d98a9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG os_vif [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1219695c-8d, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:36:39 user nova-compute[71347]: INFO os_vif [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b5:7d,bridge_name='br-int',has_traffic_filtering=True,id=1219695c-8de1-4b6b-a558-b7713d98a9a9,network=Network(1a30ed81-1d33-4eaa-95de-182342a5a2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219695c-8d')
Apr 14 14:36:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UstmfrpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:36:39 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:36:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:36:39 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7449043-a33a-4a5e-a76f-7cbf59ec762f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:36:40 user nova-compute[71347]: No targets found.
Apr 14 14:36:40 user nova-compute[71347]: iSNS:
Apr 14 14:36:40 user nova-compute[71347]: No targets found.
Apr 14 14:36:40 user nova-compute[71347]: STATIC:
Apr 14 14:36:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1
Apr 14 14:36:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:36:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:36:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221
Apr 14 14:36:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:36:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:36:40 user nova-compute[71347]: FIRMWARE:
Apr 14 14:36:40 user nova-compute[71347]: No targets found.
Apr 14 14:36:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:36:40 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:36:40 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51c5529-0f71-44af-af87-44e3f62651d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef184148-e25d-457f-a7b6-171cb872e262]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:36:40 user nova-compute[71347]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:36:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 (non-flash)
Apr 14 14:36:40 user nova-compute[71347]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:36:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50077aca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af1d59-7458-48a4-9fd0-b96e891ac87a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[34749ab6-e4a3-421b-be66-46cfc4d426d9]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e13b66-16b9-45b6-9080-7397051b3192]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c6705-a0da-4514-b1d3-56ef1792b20a]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d3514bb5', '/dev/disk/by-id/scsi-23766366363646165', '/dev/disk/by-id/scsi-1SCST_BIOd3514bb5-7f6ccdaec52a9f4a') {{(pid=82022) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1476a9-2932-4c67-a967-c9f51c4a32e8]: (4, None) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.178s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db3498-d19a-4a6f-b1b0-7ee473c48c39]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac61cbe-1d86-4a61-8325-ce21ab5f39fa]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260]
Apr 14 14:36:40 user nova-compute[71347]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221, portal: 172.16.0.220,3260] successful.
Apr 14 14:36:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1eb54abc-e5f8-4871-b539-2002d1b2a221 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f613ee-f3b3-4589-8802-85685e4de97a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] <== disconnect_volume: return (477ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:36:40 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Deleting instance files /opt/stack/data/nova/instances/ca57f876-a86b-4a47-b941-ea2fd63f1298_del
Apr 14 14:36:40 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Deletion of /opt/stack/data/nova/instances/ca57f876-a86b-4a47-b941-ea2fd63f1298_del complete
Apr 14 14:36:40 user nova-compute[71347]: INFO nova.compute.manager [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Took 1.34 seconds to destroy the instance on the hypervisor.
Apr 14 14:36:40 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:36:40 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-deleted-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:36:41 user nova-compute[71347]: INFO nova.compute.manager [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Neutron deleted interface 1219695c-8de1-4b6b-a558-b7713d98a9a9; detaching it from the instance and deleting it from the info cache
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.network.neutron [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:36:41 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Took 0.52 seconds to deallocate network for instance.
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-60e397f4-d2b6-430b-ad41-b9eec680a15b req-529bb368-c893-4d00-948e-f5f85da67df8 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Detach interface failed, port_id=1219695c-8de1-4b6b-a558-b7713d98a9a9, reason: Instance ca57f876-a86b-4a47-b941-ea2fd63f1298 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-unplugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] No waiting events found dispatching network-vif-unplugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-unplugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Acquiring lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] No waiting events found dispatching network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:36:41 user nova-compute[71347]: WARNING nova.compute.manager [req-5454f29b-64df-46f7-aca1-3e500f32d3a6 req-b884037d-c86a-4cbf-afe9-e3ad985dc617 service nova] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Received unexpected event network-vif-plugged-1219695c-8de1-4b6b-a558-b7713d98a9a9 for instance with vm_state active and task_state deleting.
Apr 14 14:36:42 user nova-compute[71347]: INFO nova.compute.manager [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Took 1.70 seconds to detach 1 volumes for instance.
Apr 14 14:36:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Deleting volume: 1eb54abc-e5f8-4871-b539-2002d1b2a221 {{(pid=71347) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 14:36:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:36:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:36:43 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:36:43 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:36:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:43 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Deleted allocations for instance ca57f876-a86b-4a47-b941-ea2fd63f1298
Apr 14 14:36:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4c7dabab-fdbd-470f-a311-154ee79f4d95 tempest-TestShelveInstance-1144252643 tempest-TestShelveInstance-1144252643-project-member] Lock "ca57f876-a86b-4a47-b941-ea2fd63f1298" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.029s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:36:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:54 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681482999.926587, ca57f876-a86b-4a47-b941-ea2fd63f1298 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:36:54 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] VM Stopped (Lifecycle Event)
Apr 14 14:36:54 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4dd7edf2-99eb-477d-aca2-21389e3b71da None None] [instance: ca57f876-a86b-4a47-b941-ea2fd63f1298] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:36:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:36:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:36:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:36:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:36:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:36:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:37:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:05 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:09 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:37:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:37:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:37:13 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:37:13 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=26.446674346923828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Applying migration context for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a as it has an incoming, in-progress migration 918ec7bf-8a64-4223-aeab-b13e73a3a0da. Migration status is finished {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 14:37:13 user nova-compute[71347]: INFO nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating resource usage from migration 918ec7bf-8a64-4223-aeab-b13e73a3a0da
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Migration 918ec7bf-8a64-4223-aeab-b13e73a3a0da is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance b8cf95c3-035b-461a-9b48-c485734bfca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 88f2170a-239e-45bd-8864-58285cdb391f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:37:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:37:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:37:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:17 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:37:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Going to confirm migration 2 {{(pid=71347) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 14:37:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:37:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquired lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:37:18 user nova-compute[71347]: DEBUG nova.network.neutron [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:37:18 user nova-compute[71347]: DEBUG nova.objects.instance [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'info_cache' on Instance uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Releasing lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG nova.objects.instance [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'migration_context' on Instance uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.260s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:19 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Deleted allocation for migration 918ec7bf-8a64-4223-aeab-b13e73a3a0da
Apr 14 14:37:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-23f777b6-4a79-4340-931d-33b16ffc5432 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.694s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:37:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:37 user nova-compute[71347]: INFO nova.compute.manager [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Terminating instance
Apr 14 14:37:37 user nova-compute[71347]: DEBUG nova.compute.manager [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-unplugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] No waiting events found dispatching network-vif-unplugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:37:37 user nova-compute[71347]: DEBUG nova.compute.manager [req-4abbf709-6158-4dab-8d5b-c60792139235 req-51b3a24d-360a-41ee-beab-56f97a6988dc service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-unplugged-33a88d60-7285-4677-a2c8-69200948dd4c for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Instance destroyed successfully.
Apr 14 14:37:38 user nova-compute[71347]: DEBUG nova.objects.instance [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lazy-loading 'resources' on Instance uuid b8cf95c3-035b-461a-9b48-c485734bfca9 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2038037319',display_name='tempest-VolumesNegativeTest-instance-2038037319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2038037319',id=34,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:35:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a000f56a044c08ae1f9192a95c8f4a',ramdisk_id='',reservation_id='r-lyhe1tby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1698798704',owner_user_name='tempest-VolumesNegativeTest-1698798704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:35:55Z,user_data=None,user_id='ebf7adeca29b487dba8146ad46a1ef4f',uuid=b8cf95c3-035b-461a-9b48-c485734bfca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Converting VIF {"id": "33a88d60-7285-4677-a2c8-69200948dd4c", "address": "fa:16:3e:05:00:71", "network": {"id": "44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8972b062c37142438150f11e483d6a85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a88d60-72", "ovs_interfaceid": "33a88d60-7285-4677-a2c8-69200948dd4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:71,bridge_name='br-int',has_traffic_filtering=True,id=33a88d60-7285-4677-a2c8-69200948dd4c,network=Network(44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a88d60-72') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG os_vif [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:71,bridge_name='br-int',has_traffic_filtering=True,id=33a88d60-7285-4677-a2c8-69200948dd4c,network=Network(44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a88d60-72') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33a88d60-72, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: INFO os_vif [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:00:71,bridge_name='br-int',has_traffic_filtering=True,id=33a88d60-7285-4677-a2c8-69200948dd4c,network=Network(44781d05-2f5a-4fa0-8cee-bf1e8f4b2f80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a88d60-72')
Apr 14 14:37:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Deleting instance files /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9_del
Apr 14 14:37:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Deletion of /opt/stack/data/nova/instances/b8cf95c3-035b-461a-9b48-c485734bfca9_del complete
Apr 14 14:37:38 user nova-compute[71347]: INFO nova.compute.manager [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 14:37:38 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:37:39 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Took 1.43 seconds to deallocate network for instance.
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-9ba99a28-fb43-4757-84c1-83bc52ed2397 req-999c4d12-901d-417f-ae37-26543dea9bd1 service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-deleted-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] No waiting events found dispatching network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:37:39 user nova-compute[71347]: WARNING nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received unexpected event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c for instance with vm_state deleted and task_state None.
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] No waiting events found dispatching network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:37:39 user nova-compute[71347]: WARNING nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received unexpected event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c for instance with vm_state deleted and task_state None.
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] No waiting events found dispatching network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:37:39 user nova-compute[71347]: WARNING nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received unexpected event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c for instance with vm_state deleted and task_state None.
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-unplugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] No waiting events found dispatching network-vif-unplugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:37:39 user nova-compute[71347]: WARNING nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received unexpected event network-vif-unplugged-33a88d60-7285-4677-a2c8-69200948dd4c for instance with vm_state deleted and task_state None.
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Acquiring lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:39 user nova-compute[71347]: DEBUG nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] No waiting events found dispatching network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:37:39 user nova-compute[71347]: WARNING nova.compute.manager [req-dea708eb-7c7d-4b6e-a6a4-2d68d353cf0d req-dd017e89-3bfd-4a9a-bf0c-10ecd4513a3e service nova] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Received unexpected event network-vif-plugged-33a88d60-7285-4677-a2c8-69200948dd4c for instance with vm_state deleted and task_state None.
Apr 14 14:37:40 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:37:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:40 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Deleted allocations for instance b8cf95c3-035b-461a-9b48-c485734bfca9
Apr 14 14:37:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-4e5044e1-cb04-49b8-8a0a-073486d0ba29 tempest-VolumesNegativeTest-1698798704 tempest-VolumesNegativeTest-1698798704-project-member] Lock "b8cf95c3-035b-461a-9b48-c485734bfca9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:37:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:53 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483058.197277, b8cf95c3-035b-461a-9b48-c485734bfca9 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:37:53 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] VM Stopped (Lifecycle Event)
Apr 14 14:37:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-90ba824b-d074-4a80-bc19-c50ecbb8b330 None None] [instance: b8cf95c3-035b-461a-9b48-c485734bfca9] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:37:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:37:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:37:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:37:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:37:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:37:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'flavor' on Instance uuid 88f2170a-239e-45bd-8864-58285cdb391f {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:38:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Ignoring supplied device name: /dev/vdb
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:02 user nova-compute[71347]: INFO nova.compute.manager [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Attaching volume eeb4c494-9ca4-4912-83ce-e23fb572545f to /dev/vdb
Apr 14 14:38:02 user nova-compute[71347]: DEBUG os_brick.utils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178d827-fd70-4625-bb6b-d33f97c9f86b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39eaa42-1f82-4da1-8495-d9fa1ea295e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b20efa-51dc-4e08-a407-48d4ba2a255d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[948138e2-7938-4af4-93c4-c45d6491be8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:38:02 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:38:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b3beb-58ad-4e9b-8f04-b4475c8145f2]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG os_brick.utils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:38:02 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Updating existing volume attachment record: b6015bd9-93e9-42eb-93ed-614090e35e5c {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:38:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:38:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:38:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:38:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:38:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:07 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIMVwPkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:38:08 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:38:08 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:38:08 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f03a74e-3872-4800-9533-d852b667ef71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:38:08 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef290709-0513-4a33-9f3d-3aa8ff95de90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f] added
Apr 14 14:38:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f56ed3d-dec0-4925-877b-2c3b1d9d7746]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[193986c5-3f41-415d-9f24-06d3f921813a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIMVwPkt {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIMVwPkt" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd8fa72-1389-4279-92bd-38fb8b13f7f3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jIMVwPkt'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[186a5c1b-ad28-4dff-a2e0-f0ffbbad7bae]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[109eea23-a00d-4362-a1d5-4742936c7469]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:38:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:38:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9e9b6d-c076-41d2-ae73-6343b9c262bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f, portal: 172.16.0.220,3260]
Apr 14 14:38:08 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f, portal: 172.16.0.220,3260] successful.
Apr 14 14:38:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e41f6f2-d216-40de-80fd-337fe275fa40]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8fdf6-8df9-4d8f-b7ad-a60f10c266b9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:38:08 user nova-compute[71347]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f (non-flash)
Apr 14 14:38:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:38:08 user nova-compute[71347]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f (non-flash)
Apr 14 14:38:08 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c079bff-cef1-4f9f-85ef-ddbeb8b9e35b]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:38:09 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:38:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIMVwPkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:38:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:38:09 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23366336638323831', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:38:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366336638323831', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:38:09 user nova-compute[71347]: DEBUG nova.objects.instance [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'flavor' on Instance uuid 88f2170a-239e-45bd-8864-58285cdb391f {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:38:09 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:38:09 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:38:09 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:38:09 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:38:09 user nova-compute[71347]:   <serial>eeb4c494-9ca4-4912-83ce-e23fb572545f</serial>
Apr 14 14:38:09 user nova-compute[71347]: </disk>
Apr 14 14:38:09 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:38:09 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:38:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:38:10 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No VIF found with MAC fa:16:3e:af:f3:73, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:38:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-6934f030-fb25-45d5-bc65-c68e0a9de262 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.758s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:38:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:38:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:38:13 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:38:13 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8417MB free_disk=26.453716278076172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 88f2170a-239e-45bd-8864-58285cdb391f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:38:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:38:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:38:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:38:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:38:15 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 48dc94a3-6933-475b-8803-828acc9d6577 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:38:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updating instance_info_cache with network_info: [{"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:38:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-48dc94a3-6933-475b-8803-828acc9d6577" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:38:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:38:17 user nova-compute[71347]: INFO nova.compute.claims [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Claim successful on node user
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:38:17 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.policy [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa6e905bd6cd4a3ab3c59888a5ee273e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10efa412c2174b31bf584dc011340328', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:38:17 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Creating image(s)
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "/opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "/opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "/opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk 1073741824" returned: 0 in 0.056s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Cannot resize image /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'migration_context' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Ensure instance console log exists: /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Successfully created port: 7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:18 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Successfully updated port: 7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquired lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-changed-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.compute.manager [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Refreshing instance network info cache due to event network-changed-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] Acquiring lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating instance_info_cache with network_info: [{"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Releasing lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Instance network_info: |[{"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] Acquired lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.neutron [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Refreshing network info cache for port 7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Start _get_guest_xml network_info=[{"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:38:19 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:38:19 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:38:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-339073380',display_name='tempest-SnapshotDataIntegrityTests-server-339073380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-339073380',id=36,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7cIH1GZq6di6+vECSTkynzLyyQ4iF/syoG1Wnz59qzkvk92HgogkMiVVvqKQ3/nkZ7p9Z3+4WCrJpgsbLPZHWBqsEzriBSLJeFWbatAbQlS/vMoGazryQ645/UCjugZQ==',key_name='tempest-SnapshotDataIntegrityTests-2051732308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10efa412c2174b31bf584dc011340328',ramdisk_id='',reservation_id='r-xbmjyzqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1043128591',owner_user_name='tempest-SnapshotDataIntegrityTests-1043128591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:38:18Z,user_data=None,user_id='aa6e905bd6cd4a3ab3c59888a5ee273e',uuid=47e05edc-4808-49de-b882-addd28b2258c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Converting VIF {"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:55:a8,bridge_name='br-int',has_traffic_filtering=True,id=7aae5c21-3ca3-43da-b71b-643dd8e5e0b4,network=Network(16b3fb2e-3da2-401b-a4ea-924cf059c727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aae5c21-3c') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'pci_devices' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:38:19 user nova-compute[71347]:   <uuid>47e05edc-4808-49de-b882-addd28b2258c</uuid>
Apr 14 14:38:19 user nova-compute[71347]:   <name>instance-00000024</name>
Apr 14 14:38:19 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:38:19 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:38:19 user nova-compute[71347]:   <metadata>
Apr 14 14:38:19 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:38:19 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:38:19 user nova-compute[71347]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-339073380</nova:name>
Apr 14 14:38:19 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:38:19</nova:creationTime>
Apr 14 14:38:19 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:38:19 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:38:19 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:38:19 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:38:19 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:38:19 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:38:19 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:38:19 user nova-compute[71347]:       <nova:owner>
Apr 14 14:38:19 user nova-compute[71347]:         <nova:user uuid="aa6e905bd6cd4a3ab3c59888a5ee273e">tempest-SnapshotDataIntegrityTests-1043128591-project-member</nova:user>
Apr 14 14:38:19 user nova-compute[71347]:         <nova:project uuid="10efa412c2174b31bf584dc011340328">tempest-SnapshotDataIntegrityTests-1043128591</nova:project>
Apr 14 14:38:19 user nova-compute[71347]:       </nova:owner>
Apr 14 14:38:19 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:38:19 user nova-compute[71347]:       <nova:ports>
Apr 14 14:38:19 user nova-compute[71347]:         <nova:port uuid="7aae5c21-3ca3-43da-b71b-643dd8e5e0b4">
Apr 14 14:38:19 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 14:38:19 user nova-compute[71347]:         </nova:port>
Apr 14 14:38:19 user nova-compute[71347]:       </nova:ports>
Apr 14 14:38:19 user nova-compute[71347]:     </nova:instance>
Apr 14 14:38:19 user nova-compute[71347]:   </metadata>
Apr 14 14:38:19 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:38:19 user nova-compute[71347]:     <system>
Apr 14 14:38:19 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:38:19 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:38:19 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:38:19 user nova-compute[71347]:       <entry name="serial">47e05edc-4808-49de-b882-addd28b2258c</entry>
Apr 14 14:38:19 user nova-compute[71347]:       <entry name="uuid">47e05edc-4808-49de-b882-addd28b2258c</entry>
Apr 14 14:38:19 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:38:19 user nova-compute[71347]:     </system>
Apr 14 14:38:19 user nova-compute[71347]:   </sysinfo>
Apr 14 14:38:19 user nova-compute[71347]:   <os>
Apr 14 14:38:19 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:38:19 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:38:19 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:38:19 user nova-compute[71347]:   </os>
Apr 14 14:38:19 user nova-compute[71347]:   <features>
Apr 14 14:38:19 user nova-compute[71347]:     <acpi/>
Apr 14 14:38:19 user nova-compute[71347]:     <apic/>
Apr 14 14:38:19 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:38:19 user nova-compute[71347]:   </features>
Apr 14 14:38:19 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:38:19 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:38:19 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:38:19 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:38:19 user nova-compute[71347]:   </clock>
Apr 14 14:38:19 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:38:19 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:38:19 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:38:19 user nova-compute[71347]:   </cpu>
Apr 14 14:38:19 user nova-compute[71347]:   <devices>
Apr 14 14:38:19 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:38:19 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:38:19 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk"/>
Apr 14 14:38:19 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:38:19 user nova-compute[71347]:     </disk>
Apr 14 14:38:19 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:38:19 user nova-compute[71347]:       <mac address="fa:16:3e:96:55:a8"/>
Apr 14 14:38:19 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:38:19 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:38:19 user nova-compute[71347]:       <target dev="tap7aae5c21-3c"/>
Apr 14 14:38:19 user nova-compute[71347]:     </interface>
Apr 14 14:38:19 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:38:19 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/console.log" append="off"/>
Apr 14 14:38:19 user nova-compute[71347]:     </serial>
Apr 14 14:38:19 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:38:19 user nova-compute[71347]:     <video>
Apr 14 14:38:19 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:38:19 user nova-compute[71347]:     </video>
Apr 14 14:38:19 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:38:19 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:38:19 user nova-compute[71347]:     </rng>
Apr 14 14:38:19 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:38:19 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:38:19 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:38:19 user nova-compute[71347]:     </memballoon>
Apr 14 14:38:19 user nova-compute[71347]:   </devices>
Apr 14 14:38:19 user nova-compute[71347]: </domain>
Apr 14 14:38:19 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:38:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-339073380',display_name='tempest-SnapshotDataIntegrityTests-server-339073380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-339073380',id=36,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7cIH1GZq6di6+vECSTkynzLyyQ4iF/syoG1Wnz59qzkvk92HgogkMiVVvqKQ3/nkZ7p9Z3+4WCrJpgsbLPZHWBqsEzriBSLJeFWbatAbQlS/vMoGazryQ645/UCjugZQ==',key_name='tempest-SnapshotDataIntegrityTests-2051732308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10efa412c2174b31bf584dc011340328',ramdisk_id='',reservation_id='r-xbmjyzqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1043128591',owner_user_name='tempest-SnapshotDataIntegrityTests-1043128591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:38:18Z,user_data=None,user_id='aa6e905bd6cd4a3ab3c59888a5ee273e',uuid=47e05edc-4808-49de-b882-addd28b2258c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Converting VIF {"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:55:a8,bridge_name='br-int',has_traffic_filtering=True,id=7aae5c21-3ca3-43da-b71b-643dd8e5e0b4,network=Network(16b3fb2e-3da2-401b-a4ea-924cf059c727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aae5c21-3c') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG os_vif [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:55:a8,bridge_name='br-int',has_traffic_filtering=True,id=7aae5c21-3ca3-43da-b71b-643dd8e5e0b4,network=Network(16b3fb2e-3da2-401b-a4ea-924cf059c727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aae5c21-3c') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7aae5c21-3c, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7aae5c21-3c, col_values=(('external_ids', {'iface-id': '7aae5c21-3ca3-43da-b71b-643dd8e5e0b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:55:a8', 'vm-uuid': '47e05edc-4808-49de-b882-addd28b2258c'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:19 user nova-compute[71347]: INFO os_vif [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:55:a8,bridge_name='br-int',has_traffic_filtering=True,id=7aae5c21-3ca3-43da-b71b-643dd8e5e0b4,network=Network(16b3fb2e-3da2-401b-a4ea-924cf059c727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aae5c21-3c')
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No VIF found with MAC fa:16:3e:96:55:a8, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.neutron [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updated VIF entry in instance network info cache for port 7aae5c21-3ca3-43da-b71b-643dd8e5e0b4. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG nova.network.neutron [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating instance_info_cache with network_info: [{"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:38:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-39874bd2-f023-49c5-8da0-2adee275564a req-5298a6d1-6f3e-4f64-84e3-04ade706aaf1 service nova] Releasing lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:38:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:38:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] No waiting events found dispatching network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:38:21 user nova-compute[71347]: WARNING nova.compute.manager [req-c911725a-05cd-47dd-b19b-c547460e8598 req-5bec6b72-b63a-4bb1-b676-e6d357bf8a3d service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received unexpected event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance with vm_state building and task_state spawning.
Apr 14 14:38:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483103.1408048, 47e05edc-4808-49de-b882-addd28b2258c => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:38:23 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] VM Resumed (Lifecycle Event)
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:38:23 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Instance spawned successfully.
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:38:23 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483103.142568, 47e05edc-4808-49de-b882-addd28b2258c => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:38:23 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] VM Started (Lifecycle Event)
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:38:23 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:38:23 user nova-compute[71347]: INFO nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:38:23 user nova-compute[71347]: INFO nova.compute.manager [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Took 6.07 seconds to build instance.
Apr 14 14:38:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7f376f0-e016-45ca-8d69-c997e5c4bea1 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.166s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] No waiting events found dispatching network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:38:23 user nova-compute[71347]: WARNING nova.compute.manager [req-587da6d9-14aa-46f0-9ad6-517d8fb30eaf req-e1391f28-c7b5-40f5-a6dd-2d71d0338c93 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received unexpected event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance with vm_state active and task_state None.
Apr 14 14:38:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:39 user nova-compute[71347]: INFO nova.compute.manager [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Detaching volume eeb4c494-9ca4-4912-83ce-e23fb572545f
Apr 14 14:38:39 user nova-compute[71347]: INFO nova.virt.block_device [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Attempting to driver detach volume eeb4c494-9ca4-4912-83ce-e23fb572545f from mountpoint /dev/vdb
Apr 14 14:38:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Attempting to detach device vdb from instance 88f2170a-239e-45bd-8864-58285cdb391f from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:38:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:38:39 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:38:39 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:38:39 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:38:39 user nova-compute[71347]:   <serial>eeb4c494-9ca4-4912-83ce-e23fb572545f</serial>
Apr 14 14:38:39 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:38:39 user nova-compute[71347]: </disk>
Apr 14 14:38:39 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:38:39 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Successfully detached device vdb from instance 88f2170a-239e-45bd-8864-58285cdb391f from the persistent domain config.
Apr 14 14:38:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88f2170a-239e-45bd-8864-58285cdb391f from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:38:39 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:38:39 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:38:39 user nova-compute[71347]:   <source dev="/dev/sdc"/>
Apr 14 14:38:39 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:38:39 user nova-compute[71347]:   <serial>eeb4c494-9ca4-4912-83ce-e23fb572545f</serial>
Apr 14 14:38:39 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:38:39 user nova-compute[71347]: </disk>
Apr 14 14:38:39 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:38:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681483120.2905245, 88f2170a-239e-45bd-8864-58285cdb391f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88f2170a-239e-45bd-8864-58285cdb391f {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:38:40 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Successfully detached device vdb from instance 88f2170a-239e-45bd-8864-58285cdb391f from the live domain config.
Apr 14 14:38:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIMVwPkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:38:40 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[257534be-bfee-42ca-9d8f-f131e62ce26e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:38:40 user nova-compute[71347]: No targets found.
Apr 14 14:38:40 user nova-compute[71347]: iSNS:
Apr 14 14:38:40 user nova-compute[71347]: No targets found.
Apr 14 14:38:40 user nova-compute[71347]: STATIC:
Apr 14 14:38:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1
Apr 14 14:38:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:38:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:38:40 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f
Apr 14 14:38:40 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:38:40 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:38:40 user nova-compute[71347]: FIRMWARE:
Apr 14 14:38:40 user nova-compute[71347]: No targets found.
Apr 14 14:38:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:38:40 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:38:40 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc398de-5756-4b18-bd7f-a66b8a2a45c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3929a1d-5c92-4868-a8ed-fd709f66f155]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:38:40 user nova-compute[71347]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f (non-flash)
Apr 14 14:38:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:38:40 user nova-compute[71347]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f (non-flash)
Apr 14 14:38:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4e11510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[914f97b3-efca-46c6-b3f3-ac9143ee566f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b6c31-208c-44fc-8ba2-bbb70d31dc89]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e913bef4-af66-460c-b06a-9ca98d7eedef]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b8bce5-44f4-40cd-bb10-b8a57b7d69a3]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f214689-86cc-4d24-9b7a-070b8baaa0df]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8ec2c1-353b-4146-8ee2-193c7c92fb3d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f, portal: 172.16.0.220,3260]
Apr 14 14:38:40 user nova-compute[71347]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f, portal: 172.16.0.220,3260] successful.
Apr 14 14:38:40 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3530d083-8bef-4746-aaf5-5ec11775f218]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] <== disconnect_volume: return (359ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:38:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG nova.objects.instance [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'flavor' on Instance uuid 88f2170a-239e-45bd-8864-58285cdb391f {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9f00aa7c-5a6b-47a1-96ed-d95736700132 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.893s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.735s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:41 user nova-compute[71347]: INFO nova.compute.manager [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Terminating instance
Apr 14 14:38:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received event network-vif-unplugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] No waiting events found dispatching network-vif-unplugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:38:41 user nova-compute[71347]: DEBUG nova.compute.manager [req-61f1eaba-43ab-4e2c-871c-674a1a7be888 req-9470ccf9-9eab-48c9-bd65-12c63a53e180 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received event network-vif-unplugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Instance destroyed successfully.
Apr 14 14:38:42 user nova-compute[71347]: DEBUG nova.objects.instance [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'resources' on Instance uuid 88f2170a-239e-45bd-8864-58285cdb391f {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-352344162',display_name='tempest-VolumesSnapshotTestJSON-instance-352344162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-352344162',id=35,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:36:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fab35b3694734461828bb8bd19f4bc65',ramdisk_id='',reservation_id='r-ixftbgyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1438289684',owner_user_name='tempest-VolumesSnapshotTestJSON-1438289684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:36:19Z,user_data=None,user_id='506ec17dec9149698ca687d2ce256acd',uuid=88f2170a-239e-45bd-8864-58285cdb391f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converting VIF {"id": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "address": "fa:16:3e:af:f3:73", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22cb4d2-f7", "ovs_interfaceid": "f22cb4d2-f783-4b93-b220-44ac1d92d8d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:f3:73,bridge_name='br-int',has_traffic_filtering=True,id=f22cb4d2-f783-4b93-b220-44ac1d92d8d2,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22cb4d2-f7') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_vif [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:f3:73,bridge_name='br-int',has_traffic_filtering=True,id=f22cb4d2-f783-4b93-b220-44ac1d92d8d2,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22cb4d2-f7') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf22cb4d2-f7, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:38:42 user nova-compute[71347]: INFO os_vif [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:f3:73,bridge_name='br-int',has_traffic_filtering=True,id=f22cb4d2-f783-4b93-b220-44ac1d92d8d2,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22cb4d2-f7')
Apr 14 14:38:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIMVwPkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:38:42 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c377e29-9215-4645-b561-bdc8d6eeac32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:38:42 user nova-compute[71347]: No targets found.
Apr 14 14:38:42 user nova-compute[71347]: iSNS:
Apr 14 14:38:42 user nova-compute[71347]: No targets found.
Apr 14 14:38:42 user nova-compute[71347]: STATIC:
Apr 14 14:38:42 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1
Apr 14 14:38:42 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:38:42 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:38:42 user nova-compute[71347]: FIRMWARE:
Apr 14 14:38:42 user nova-compute[71347]: No targets found.
Apr 14 14:38:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:38:42 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:38:42 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb4c494-9ca4-4912-83ce-e23fb572545f', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[996568c3-e391-4102-b222-caed05e46413]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[444f467c-4fda-43b5-b018-3eebe97d6424]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:38:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:38:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50077aca60>, {}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Disconnecting from: [] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] <== disconnect_volume: return (70ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:38:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Deleting instance files /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f_del
Apr 14 14:38:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Deletion of /opt/stack/data/nova/instances/88f2170a-239e-45bd-8864-58285cdb391f_del complete
Apr 14 14:38:42 user nova-compute[71347]: INFO nova.compute.manager [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Took 1.09 seconds to destroy the instance on the hypervisor.
Apr 14 14:38:42 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:38:42 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:38:43 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Took 0.76 seconds to deallocate network for instance.
Apr 14 14:38:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-6e76ebf2-0444-4118-aa8a-5d8da0072e55 req-5af7588e-ea42-4e91-b440-62f5b4415662 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received event network-vif-deleted-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:38:43 user nova-compute[71347]: WARNING nova.volume.cinder [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Attachment b6015bd9-93e9-42eb-93ed-614090e35e5c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b6015bd9-93e9-42eb-93ed-614090e35e5c. (HTTP 404) (Request-ID: req-ad02e804-4042-4d3f-9f5a-bc1520311b27)
Apr 14 14:38:43 user nova-compute[71347]: INFO nova.compute.manager [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Took 0.02 seconds to detach 1 volumes for instance.
Apr 14 14:38:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:43 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Deleted allocations for instance 88f2170a-239e-45bd-8864-58285cdb391f
Apr 14 14:38:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-40afd550-cca5-47b6-bf83-355d726a7383 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "88f2170a-239e-45bd-8864-58285cdb391f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.243s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received event network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] Acquiring lock "88f2170a-239e-45bd-8864-58285cdb391f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] Lock "88f2170a-239e-45bd-8864-58285cdb391f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:38:43 user nova-compute[71347]: DEBUG nova.compute.manager [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] No waiting events found dispatching network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:38:43 user nova-compute[71347]: WARNING nova.compute.manager [req-03d27656-4264-4495-8879-e347be9bc9cb req-1b6e5fb5-fb89-43e4-824d-814796bc74a9 service nova] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Received unexpected event network-vif-plugged-f22cb4d2-f783-4b93-b220-44ac1d92d8d2 for instance with vm_state deleted and task_state None.
Apr 14 14:38:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:57 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483122.4637158, 88f2170a-239e-45bd-8864-58285cdb391f => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:38:57 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] VM Stopped (Lifecycle Event)
Apr 14 14:38:57 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56ff4456-81d9-4951-8355-a9679b268534 None None] [instance: 88f2170a-239e-45bd-8864-58285cdb391f] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:38:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:38:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:38:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:38:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:38:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:38:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:08 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:10 user nova-compute[71347]: INFO nova.compute.manager [None req-ec587211-4ad1-4771-9b16-3e541d257ea1 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Get console output
Apr 14 14:39:10 user nova-compute[71347]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 14:39:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:11 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:39:12 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:39:12 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:39:12 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8477MB free_disk=26.439212799072266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 47e05edc-4808-49de-b882-addd28b2258c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:39:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:39:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:39:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:39:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:39:16 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [{"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:39:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-6d350d39-ba90-4e7f-8f95-bf565f787b0a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:39:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:39:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:18 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:20 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:21 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:39:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:39:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:39:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:39:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:39:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:39:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:39:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:39:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:39:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:39:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:39:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:39:46 user nova-compute[71347]: INFO nova.compute.claims [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Claim successful on node user
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:39:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.policy [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '506ec17dec9149698ca687d2ce256acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab35b3694734461828bb8bd19f4bc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:39:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Creating image(s)
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "/opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "/opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "/opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.128s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk 1073741824" returned: 0 in 0.062s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Cannot resize image /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'migration_context' on Instance uuid 6952658d-8c9d-4359-9f90-04a35e6126a1 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Ensure instance console log exists: /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:47 user nova-compute[71347]: DEBUG nova.network.neutron [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Successfully created port: 3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Successfully updated port: 3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "refresh_cache-6952658d-8c9d-4359-9f90-04a35e6126a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquired lock "refresh_cache-6952658d-8c9d-4359-9f90-04a35e6126a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received event network-changed-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Refreshing instance network info cache due to event network-changed-3f927ec3-3cdd-4128-89da-07d4ec7e02c9. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] Acquiring lock "refresh_cache-6952658d-8c9d-4359-9f90-04a35e6126a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.neutron [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Updating instance_info_cache with network_info: [{"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Releasing lock "refresh_cache-6952658d-8c9d-4359-9f90-04a35e6126a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Instance network_info: |[{"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] Acquired lock "refresh_cache-6952658d-8c9d-4359-9f90-04a35e6126a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.neutron [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Refreshing network info cache for port 3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Start _get_guest_xml network_info=[{"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:39:48 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:39:48 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-404552932',display_name='tempest-VolumesSnapshotTestJSON-instance-404552932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-404552932',id=37,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fab35b3694734461828bb8bd19f4bc65',ramdisk_id='',reservation_id='r-08b6di2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1438289684',owner_user_name='tempest-VolumesSnapshotTestJSON-1438289684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:39:47Z,user_data=None,user_id='506ec17dec9149698ca687d2ce256acd',uuid=6952658d-8c9d-4359-9f90-04a35e6126a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converting VIF {"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:c4,bridge_name='br-int',has_traffic_filtering=True,id=3f927ec3-3cdd-4128-89da-07d4ec7e02c9,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f927ec3-3c') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.objects.instance [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'pci_devices' on Instance uuid 6952658d-8c9d-4359-9f90-04a35e6126a1 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:39:48 user nova-compute[71347]:   <uuid>6952658d-8c9d-4359-9f90-04a35e6126a1</uuid>
Apr 14 14:39:48 user nova-compute[71347]:   <name>instance-00000025</name>
Apr 14 14:39:48 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:39:48 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:39:48 user nova-compute[71347]:   <metadata>
Apr 14 14:39:48 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:39:48 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:39:48 user nova-compute[71347]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-404552932</nova:name>
Apr 14 14:39:48 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:39:48</nova:creationTime>
Apr 14 14:39:48 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:39:48 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:39:48 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:39:48 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:39:48 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:39:48 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:39:48 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:39:48 user nova-compute[71347]:       <nova:owner>
Apr 14 14:39:48 user nova-compute[71347]:         <nova:user uuid="506ec17dec9149698ca687d2ce256acd">tempest-VolumesSnapshotTestJSON-1438289684-project-member</nova:user>
Apr 14 14:39:48 user nova-compute[71347]:         <nova:project uuid="fab35b3694734461828bb8bd19f4bc65">tempest-VolumesSnapshotTestJSON-1438289684</nova:project>
Apr 14 14:39:48 user nova-compute[71347]:       </nova:owner>
Apr 14 14:39:48 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:39:48 user nova-compute[71347]:       <nova:ports>
Apr 14 14:39:48 user nova-compute[71347]:         <nova:port uuid="3f927ec3-3cdd-4128-89da-07d4ec7e02c9">
Apr 14 14:39:48 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 14:39:48 user nova-compute[71347]:         </nova:port>
Apr 14 14:39:48 user nova-compute[71347]:       </nova:ports>
Apr 14 14:39:48 user nova-compute[71347]:     </nova:instance>
Apr 14 14:39:48 user nova-compute[71347]:   </metadata>
Apr 14 14:39:48 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:39:48 user nova-compute[71347]:     <system>
Apr 14 14:39:48 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:39:48 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:39:48 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:39:48 user nova-compute[71347]:       <entry name="serial">6952658d-8c9d-4359-9f90-04a35e6126a1</entry>
Apr 14 14:39:48 user nova-compute[71347]:       <entry name="uuid">6952658d-8c9d-4359-9f90-04a35e6126a1</entry>
Apr 14 14:39:48 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:39:48 user nova-compute[71347]:     </system>
Apr 14 14:39:48 user nova-compute[71347]:   </sysinfo>
Apr 14 14:39:48 user nova-compute[71347]:   <os>
Apr 14 14:39:48 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:39:48 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:39:48 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:39:48 user nova-compute[71347]:   </os>
Apr 14 14:39:48 user nova-compute[71347]:   <features>
Apr 14 14:39:48 user nova-compute[71347]:     <acpi/>
Apr 14 14:39:48 user nova-compute[71347]:     <apic/>
Apr 14 14:39:48 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:39:48 user nova-compute[71347]:   </features>
Apr 14 14:39:48 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:39:48 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:39:48 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:39:48 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:39:48 user nova-compute[71347]:   </clock>
Apr 14 14:39:48 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:39:48 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:39:48 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:39:48 user nova-compute[71347]:   </cpu>
Apr 14 14:39:48 user nova-compute[71347]:   <devices>
Apr 14 14:39:48 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:39:48 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:39:48 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk"/>
Apr 14 14:39:48 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:39:48 user nova-compute[71347]:     </disk>
Apr 14 14:39:48 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:39:48 user nova-compute[71347]:       <mac address="fa:16:3e:82:85:c4"/>
Apr 14 14:39:48 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:39:48 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:39:48 user nova-compute[71347]:       <target dev="tap3f927ec3-3c"/>
Apr 14 14:39:48 user nova-compute[71347]:     </interface>
Apr 14 14:39:48 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:39:48 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/console.log" append="off"/>
Apr 14 14:39:48 user nova-compute[71347]:     </serial>
Apr 14 14:39:48 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:39:48 user nova-compute[71347]:     <video>
Apr 14 14:39:48 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:39:48 user nova-compute[71347]:     </video>
Apr 14 14:39:48 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:39:48 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:39:48 user nova-compute[71347]:     </rng>
Apr 14 14:39:48 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:39:48 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:39:48 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:39:48 user nova-compute[71347]:     </memballoon>
Apr 14 14:39:48 user nova-compute[71347]:   </devices>
Apr 14 14:39:48 user nova-compute[71347]: </domain>
Apr 14 14:39:48 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-404552932',display_name='tempest-VolumesSnapshotTestJSON-instance-404552932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-404552932',id=37,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fab35b3694734461828bb8bd19f4bc65',ramdisk_id='',reservation_id='r-08b6di2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1438289684',owner_user_name='tempest-VolumesSnapshotTestJSON-1438289684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:39:47Z,user_data=None,user_id='506ec17dec9149698ca687d2ce256acd',uuid=6952658d-8c9d-4359-9f90-04a35e6126a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converting VIF {"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:c4,bridge_name='br-int',has_traffic_filtering=True,id=3f927ec3-3cdd-4128-89da-07d4ec7e02c9,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f927ec3-3c') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG os_vif [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:c4,bridge_name='br-int',has_traffic_filtering=True,id=3f927ec3-3cdd-4128-89da-07d4ec7e02c9,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f927ec3-3c') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f927ec3-3c, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f927ec3-3c, col_values=(('external_ids', {'iface-id': '3f927ec3-3cdd-4128-89da-07d4ec7e02c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:85:c4', 'vm-uuid': '6952658d-8c9d-4359-9f90-04a35e6126a1'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:39:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:48 user nova-compute[71347]: INFO os_vif [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:c4,bridge_name='br-int',has_traffic_filtering=True,id=3f927ec3-3cdd-4128-89da-07d4ec7e02c9,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f927ec3-3c')
Apr 14 14:39:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:39:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No VIF found with MAC fa:16:3e:82:85:c4, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:39:49 user nova-compute[71347]: DEBUG nova.network.neutron [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Updated VIF entry in instance network info cache for port 3f927ec3-3cdd-4128-89da-07d4ec7e02c9. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:39:49 user nova-compute[71347]: DEBUG nova.network.neutron [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Updating instance_info_cache with network_info: [{"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:39:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-fe69cd20-4dcd-4024-b083-d7ba2aecef9f req-f088fd9f-9641-4ddd-9163-2a555def71d5 service nova] Releasing lock "refresh_cache-6952658d-8c9d-4359-9f90-04a35e6126a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:39:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received event network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:39:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] No waiting events found dispatching network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:39:50 user nova-compute[71347]: WARNING nova.compute.manager [req-1f827d38-cc81-4ff4-987f-d2278fb1c2f0 req-e67fb139-9807-4da7-988d-880b4cac6847 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received unexpected event network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance with vm_state building and task_state spawning.
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483192.501158, 6952658d-8c9d-4359-9f90-04a35e6126a1 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:39:52 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] VM Resumed (Lifecycle Event)
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:39:52 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Instance spawned successfully.
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:39:52 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483192.502433, 6952658d-8c9d-4359-9f90-04a35e6126a1 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:39:52 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] VM Started (Lifecycle Event)
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:39:52 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:39:52 user nova-compute[71347]: INFO nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Took 5.63 seconds to spawn the instance on the hypervisor.
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received event network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] No waiting events found dispatching network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:39:52 user nova-compute[71347]: WARNING nova.compute.manager [req-e343efc7-0c77-47d1-9458-d9182cbcabb4 req-0576d5c0-b417-413a-ae1b-5df4212fcb90 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received unexpected event network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance with vm_state building and task_state spawning.
Apr 14 14:39:52 user nova-compute[71347]: INFO nova.compute.manager [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Took 6.20 seconds to build instance.
Apr 14 14:39:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-251586ca-f76d-4cbb-9789-15c9e8a44ce6 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.306s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:39:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:39:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:40:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:40:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:40:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:40:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:09 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:11 user nova-compute[71347]: INFO nova.compute.manager [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Terminating instance
Apr 14 14:40:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-unplugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] No waiting events found dispatching network-vif-unplugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-7dcf1e2f-dec9-4f22-b962-1bf99cc7852d req-9faf1235-75b9-4298-bb64-063cbf027baa service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-unplugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-changed-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Refreshing instance network info cache due to event network-changed-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] Acquiring lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] Acquired lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:40:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Refreshing network info cache for port 7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:40:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Instance destroyed successfully.
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.objects.instance [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'resources' on Instance uuid 6d350d39-ba90-4e7f-8f95-bf565f787b0a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842987954',display_name='tempest-ServerActionsTestJSON-server-1842987954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842987954',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-85xknzdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=6d350d39-ba90-4e7f-8f95-bf565f787b0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "address": "fa:16:3e:22:07:00", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap749a0a24-f4", "ovs_interfaceid": "749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_vif [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap749a0a24-f4, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:40:12 user nova-compute[71347]: INFO os_vif [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:07:00,bridge_name='br-int',has_traffic_filtering=True,id=749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap749a0a24-f4')
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSVlLBgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:40:12 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6bf880-22bc-4819-8aea-c44829800198]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:40:12 user nova-compute[71347]: No targets found.
Apr 14 14:40:12 user nova-compute[71347]: iSNS:
Apr 14 14:40:12 user nova-compute[71347]: No targets found.
Apr 14 14:40:12 user nova-compute[71347]: STATIC:
Apr 14 14:40:12 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1
Apr 14 14:40:12 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:40:12 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:40:12 user nova-compute[71347]: FIRMWARE:
Apr 14 14:40:12 user nova-compute[71347]: No targets found.
Apr 14 14:40:12 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:40:12 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:40:12 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dd8c18-9705-4459-924c-356a031fb82f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fdce4b-3d13-4515-9503-5da583eaee63]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:40:12 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 (non-flash)
Apr 14 14:40:12 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4efcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a8178d-9ae8-4bf7-9bab-25514a3226b0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[44470fdf-01f8-4732-b65c-083ea692b184]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0423f0ac-c74d-4493-be8c-2114ce569f90]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e0b72f-7b3a-48ba-ae76-5d3c2a8218d8]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[672bb0c6-ae25-4f24-b501-5ceb755fe3a5]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.network.neutron [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updated VIF entry in instance network info cache for port 7aae5c21-3ca3-43da-b71b-643dd8e5e0b4. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.network.neutron [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating instance_info_cache with network_info: [{"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-915acb2e-95bd-4018-bcce-7adcca8d9979 req-aed408cd-8dd0-471a-930c-493f778463bf service nova] Releasing lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b937e9f4-e6a9-4a43-ba5d-34078820df58]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260]
Apr 14 14:40:12 user nova-compute[71347]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1, portal: 172.16.0.220,3260] successful.
Apr 14 14:40:12 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[728db0a3-9c06-4080-9e17-f1415efe4786]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] <== disconnect_volume: return (312ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:40:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Deleting instance files /opt/stack/data/nova/instances/6d350d39-ba90-4e7f-8f95-bf565f787b0a_del
Apr 14 14:40:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Deletion of /opt/stack/data/nova/instances/6d350d39-ba90-4e7f-8f95-bf565f787b0a_del complete
Apr 14 14:40:12 user nova-compute[71347]: INFO nova.compute.manager [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 14:40:12 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:40:12 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG nova.objects.instance [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:13 user nova-compute[71347]: INFO nova.compute.manager [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attaching volume d1f13c70-6029-4595-b745-31a56b177e54 to /dev/vdb
Apr 14 14:40:13 user nova-compute[71347]: DEBUG os_brick.utils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8ab07e-40f6-422b-b95d-1fc44368dffe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f5d70d-93f1-4154-a1e3-1883b82734ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b545376-f7ea-46ef-8bff-07c414bdc774]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a2586-c3ed-448e-831b-6a7d2d085fbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:40:13 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fe1c05-1c15-4aed-8ee3-1e4105fdd041]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG os_brick.utils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating existing volume attachment record: c7ee105b-e614-4bb9-ae8d-91aa625e9bae {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:40:13 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Took 1.26 seconds to deallocate network for instance.
Apr 14 14:40:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Acquiring lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] No waiting events found dispatching network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:40:13 user nova-compute[71347]: WARNING nova.compute.manager [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received unexpected event network-vif-plugged-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 for instance with vm_state active and task_state deleting.
Apr 14 14:40:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-c8e69f05-e551-49e2-ac01-0cae2118fd21 req-3e264167-bbea-4d0b-b289-a6d5e103d78f service nova] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Received event network-vif-deleted-749a0a24-f4a8-4cf0-aa1b-c5e9d076d3f1 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:13 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:14 user nova-compute[71347]: INFO nova.compute.manager [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Took 0.83 seconds to detach 1 volumes for instance.
Apr 14 14:40:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Deleting volume: 9f7477fa-a8e6-43ae-beb7-3d0c30a7a8e1 {{(pid=71347) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:15 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:40:15 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=26.41783905029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.616s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.070s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:15 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Deleted allocations for instance 6d350d39-ba90-4e7f-8f95-bf565f787b0a
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48dc94a3-6933-475b-8803-828acc9d6577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 47e05edc-4808-49de-b882-addd28b2258c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6952658d-8c9d-4359-9f90-04a35e6126a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d22eb3b8-3395-4c03-91e1-75cba7fa3e46 tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "6d350d39-ba90-4e7f-8f95-bf565f787b0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.178s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:40:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:40:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:17 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:40:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBMjNoUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:40:18 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:40:18 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:40:18 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4d5ca7-25b5-4ae5-af9c-d2aa6f7bb456]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:40:18 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f023012-7a3d-4750-978d-0c0cc67583c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54] added
Apr 14 14:40:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae72ec-c56d-47ca-aebb-a91f2f1d2af5]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd44560f-c505-4b1f-b5da-fbd3065e015d]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBMjNoUt {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBMjNoUt" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f5cc8-6209-4556-90fe-7a31f1b62cbe]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EBMjNoUt'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cbdd81-fee2-4151-a7e9-4f76496789d1]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c723f8-9097-4ebf-83c5-63a31575a14f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:40:18 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:40:18 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:40:18 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:40:18 user nova-compute[71347]: 
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c9984a-7f2a-4356-a502-a517c4069ed1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54, portal: 172.16.0.220,3260]
Apr 14 14:40:18 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54, portal: 172.16.0.220,3260] successful.
Apr 14 14:40:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3922ce2c-33f8-4782-bc79-0a19822b7bed]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[df78a0fb-8602-416f-a22a-d15d406b9918]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 (non-flash)
Apr 14 14:40:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 (non-flash)
Apr 14 14:40:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdf5125-2a47-4c89-832c-4a2ab4277e1e]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBMjNoUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:40:18 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:40:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26235323465626162', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:40:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235323465626162', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:40:19 user nova-compute[71347]: DEBUG nova.objects.instance [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:40:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:40:19 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:40:19 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:40:19 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:40:19 user nova-compute[71347]:   <serial>d1f13c70-6029-4595-b745-31a56b177e54</serial>
Apr 14 14:40:19 user nova-compute[71347]: </disk>
Apr 14 14:40:19 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:40:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:40:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:40:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No VIF found with MAC fa:16:3e:96:55:a8, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:40:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-42b9c105-053f-448f-820d-07b5276112b0 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.860s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:21 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:40:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:27 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483212.1129963, 6d350d39-ba90-4e7f-8f95-bf565f787b0a => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:40:27 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] VM Stopped (Lifecycle Event)
Apr 14 14:40:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-fb75cd6a-f448-49a7-8b9e-ba5fceff5a0e None None] [instance: 6d350d39-ba90-4e7f-8f95-bf565f787b0a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:40:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:40:33 user nova-compute[71347]: INFO nova.compute.manager [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Detaching volume d1f13c70-6029-4595-b745-31a56b177e54
Apr 14 14:40:33 user nova-compute[71347]: INFO nova.virt.block_device [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attempting to driver detach volume d1f13c70-6029-4595-b745-31a56b177e54 from mountpoint /dev/vdb
Apr 14 14:40:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Attempting to detach device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:40:33 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:40:33 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:40:33 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:40:33 user nova-compute[71347]:   <serial>d1f13c70-6029-4595-b745-31a56b177e54</serial>
Apr 14 14:40:33 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:40:33 user nova-compute[71347]: </disk>
Apr 14 14:40:33 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:40:33 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully detached device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the persistent domain config.
Apr 14 14:40:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47e05edc-4808-49de-b882-addd28b2258c from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:40:33 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:40:33 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:40:33 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:40:33 user nova-compute[71347]:   <serial>d1f13c70-6029-4595-b745-31a56b177e54</serial>
Apr 14 14:40:33 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:40:33 user nova-compute[71347]: </disk>
Apr 14 14:40:33 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681483233.6103137, 47e05edc-4808-49de-b882-addd28b2258c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:40:33 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully detached device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the live domain config.
Apr 14 14:40:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBMjNoUt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:40:33 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f830cd-b3ae-4174-9bde-a4a97e20c58d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:40:33 user nova-compute[71347]: No targets found.
Apr 14 14:40:33 user nova-compute[71347]: iSNS:
Apr 14 14:40:33 user nova-compute[71347]: No targets found.
Apr 14 14:40:33 user nova-compute[71347]: STATIC:
Apr 14 14:40:33 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54
Apr 14 14:40:33 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:40:33 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:40:33 user nova-compute[71347]: FIRMWARE:
Apr 14 14:40:33 user nova-compute[71347]: No targets found.
Apr 14 14:40:33 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:40:33 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:40:33 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a4d3d5-17fe-4b67-a4d0-c53d64486cdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31b855f-a62d-4104-86d4-4f845ad83062]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 (non-flash)
Apr 14 14:40:33 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 (non-flash)
Apr 14 14:40:33 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4db2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7939abdb-a762-47f3-add5-d610f6e7d140]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[108bd194-4909-4508-8994-2ed6a6165097]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c58b2be-32fc-40ed-93e2-f933f08b80d6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b533d9-846c-43ee-a156-9c07e89d5194]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[755cd4c7-95c7-495b-b7ac-a34993009b8a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[13991130-6924-4a22-929f-dafc7954caa0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54, portal: 172.16.0.220,3260]
Apr 14 14:40:33 user nova-compute[71347]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54, portal: 172.16.0.220,3260] successful.
Apr 14 14:40:33 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1f13c70-6029-4595-b745-31a56b177e54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be2d674-46fc-4ad7-827f-a375af29b286]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== disconnect_volume: return (303ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:40:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:40:34 user nova-compute[71347]: DEBUG nova.objects.instance [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:40:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-636a020c-ac15-4899-ba21-86d0b2b83838 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:40:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:40:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:40:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "48dc94a3-6933-475b-8803-828acc9d6577" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "48dc94a3-6933-475b-8803-828acc9d6577" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "48dc94a3-6933-475b-8803-828acc9d6577-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:02 user nova-compute[71347]: INFO nova.compute.manager [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Terminating instance
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-vif-unplugged-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] Acquiring lock "48dc94a3-6933-475b-8803-828acc9d6577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] No waiting events found dispatching network-vif-unplugged-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-4450aa86-9575-4824-bac8-2eefee1039c5 req-67846f09-d4c3-464e-b650-5c1527f49505 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-vif-unplugged-a7f26438-6282-4bdb-a730-cddb218c10ce for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Instance destroyed successfully.
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lazy-loading 'resources' on Instance uuid 48dc94a3-6933-475b-8803-828acc9d6577 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1361343797',display_name='tempest-ServerActionsTestJSON-server-1361343797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1361343797',id=31,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOKzjnp9Hi96Mlw7NFnUcZ4nxQAEvl3VwLqKS8Yj1pMn8M/DIuf+FvHBb6mtB6e2qnoGC2NCQbgpahXcK2C6YB2tE1KQ6d2Lm3zS1t7EZB7VUdaBikJKQvIgDpBwGHZ6A==',key_name='tempest-keypair-220938053',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:31:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b087f26a80045f3844873220a67a4e4',ramdisk_id='',reservation_id='r-6qxnv59y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-932644409',owner_user_name='tempest-ServerActionsTestJSON-932644409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797d2d1bff8e4b26afe7856e4c3877cf',uuid=48dc94a3-6933-475b-8803-828acc9d6577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converting VIF {"id": "a7f26438-6282-4bdb-a730-cddb218c10ce", "address": "fa:16:3e:88:05:97", "network": {"id": "3d9490f5-8130-426e-9126-f2edafc77fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-2021374269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b087f26a80045f3844873220a67a4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7f26438-62", "ovs_interfaceid": "a7f26438-6282-4bdb-a730-cddb218c10ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:05:97,bridge_name='br-int',has_traffic_filtering=True,id=a7f26438-6282-4bdb-a730-cddb218c10ce,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f26438-62') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG os_vif [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:05:97,bridge_name='br-int',has_traffic_filtering=True,id=a7f26438-6282-4bdb-a730-cddb218c10ce,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f26438-62') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7f26438-62, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:41:02 user nova-compute[71347]: INFO os_vif [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:05:97,bridge_name='br-int',has_traffic_filtering=True,id=a7f26438-6282-4bdb-a730-cddb218c10ce,network=Network(3d9490f5-8130-426e-9126-f2edafc77fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7f26438-62')
Apr 14 14:41:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Deleting instance files /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577_del
Apr 14 14:41:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Deletion of /opt/stack/data/nova/instances/48dc94a3-6933-475b-8803-828acc9d6577_del complete
Apr 14 14:41:02 user nova-compute[71347]: INFO nova.compute.manager [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 14 14:41:02 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:41:02 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:41:03 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:41:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-vif-deleted-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:41:03 user nova-compute[71347]: INFO nova.compute.manager [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Neutron deleted interface a7f26438-6282-4bdb-a730-cddb218c10ce; detaching it from the instance and deleting it from the info cache
Apr 14 14:41:03 user nova-compute[71347]: DEBUG nova.network.neutron [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:41:03 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Took 0.76 seconds to deallocate network for instance.
Apr 14 14:41:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab894746-201e-4720-a98b-66b8b0befe36 req-e39dee41-cd37-4871-9fb7-6baad3cb6436 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Detach interface failed, port_id=a7f26438-6282-4bdb-a730-cddb218c10ce, reason: Instance 48dc94a3-6933-475b-8803-828acc9d6577 could not be found. {{(pid=71347) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 14:41:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:03 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:41:03 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:41:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:03 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Deleted allocations for instance 48dc94a3-6933-475b-8803-828acc9d6577
Apr 14 14:41:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-e4b591c9-c938-43c9-99d7-92d167b0ea7d tempest-ServerActionsTestJSON-932644409 tempest-ServerActionsTestJSON-932644409-project-member] Lock "48dc94a3-6933-475b-8803-828acc9d6577" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.749s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received event network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:41:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] Acquiring lock "48dc94a3-6933-475b-8803-828acc9d6577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] Lock "48dc94a3-6933-475b-8803-828acc9d6577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] No waiting events found dispatching network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:41:04 user nova-compute[71347]: WARNING nova.compute.manager [req-7eaf5838-7c6f-48a8-ae26-ededc1b078b0 req-90dad700-4ddc-4dfa-9a39-e1368f6ec3f2 service nova] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Received unexpected event network-vif-plugged-a7f26438-6282-4bdb-a730-cddb218c10ce for instance with vm_state deleted and task_state None.
Apr 14 14:41:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:15 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:16 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:41:16 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:41:16 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8595MB free_disk=26.436180114746094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 47e05edc-4808-49de-b882-addd28b2258c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 6952658d-8c9d-4359-9f90-04a35e6126a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483262.6741905, 48dc94a3-6933-475b-8803-828acc9d6577 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:41:17 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] VM Stopped (Lifecycle Event)
Apr 14 14:41:17 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e803abad-e9de-43cd-baff-55609b1efb36 None None] [instance: 48dc94a3-6933-475b-8803-828acc9d6577] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:41:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:18 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:18 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:41:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:41:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:41:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:41:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:41:19 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:41:19 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:41:20 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating instance_info_cache with network_info: [{"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:41:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:41:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:41:20 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:26 user nova-compute[71347]: DEBUG nova.objects.instance [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:41:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:41:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:26 user nova-compute[71347]: INFO nova.compute.manager [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attaching volume a7da4ec7-6705-4f91-8c95-a082e8cc989b to /dev/vdb
Apr 14 14:41:27 user nova-compute[71347]: DEBUG os_brick.utils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7198c64-4dc2-4850-8c0e-6bdffea0f7cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e0226-f7ac-4d47-adb3-9ad46b04e938]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[756a6a65-c99e-434c-8ed0-327c697a7438]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e30990-de93-4fa4-bb4a-fc16cc87ca20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:41:27 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:41:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1c2418-8876-45ca-be12-a5c5dabb64fd]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG os_brick.utils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating existing volume attachment record: 7e5ce0ec-1232-4d44-8a0b-5cc92f979066 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:41:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:41:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmdyufv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:41:31 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:41:31 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:41:31 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf67bc1-acaa-4a85-b8f4-ad50190131cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:41:31 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[822facb7-ff84-40e1-ab8a-b4d81c990cd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b] added
Apr 14 14:41:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff7932-2d1b-4e10-b32c-5c17fac5cbc8]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ccbdf2-f1da-4f08-8e9f-f5849f579ba2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abmdyufv {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abmdyufv" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b7ca67-06d1-4dfa-8cc7-53bf1757be1a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abmdyufv'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8100a9e-4275-41bb-8a54-d44744ed122b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb0ac1-1d33-4fdd-b6a9-148ac43f8aff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:41:31 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:41:31 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:41:31 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:41:31 user nova-compute[71347]: 
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[079738ae-1850-4558-a3f4-5cfe1f9582e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b, portal: 172.16.0.220,3260]
Apr 14 14:41:31 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b, portal: 172.16.0.220,3260] successful.
Apr 14 14:41:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9809bdd1-1063-45bb-b2e5-3f014031b222]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e89019-1ba3-49ff-be8d-93b690a117cf]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b (non-flash)
Apr 14 14:41:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b (non-flash)
Apr 14 14:41:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa7b6c-63ae-49af-ad85-d2fdbee30bae]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:41:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:32 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:41:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmdyufv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:41:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:41:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26365626336393266', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:41:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365626336393266', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:41:32 user nova-compute[71347]: DEBUG nova.objects.instance [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:41:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:41:32 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:41:32 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:41:32 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:41:32 user nova-compute[71347]:   <serial>a7da4ec7-6705-4f91-8c95-a082e8cc989b</serial>
Apr 14 14:41:32 user nova-compute[71347]: </disk>
Apr 14 14:41:32 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:41:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:41:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:41:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No VIF found with MAC fa:16:3e:96:55:a8, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:41:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91605afa-74a2-4a3b-8680-6ffeb3e0cac6 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.532s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:35 user nova-compute[71347]: INFO nova.compute.manager [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Detaching volume a7da4ec7-6705-4f91-8c95-a082e8cc989b
Apr 14 14:41:35 user nova-compute[71347]: INFO nova.virt.block_device [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attempting to driver detach volume a7da4ec7-6705-4f91-8c95-a082e8cc989b from mountpoint /dev/vdb
Apr 14 14:41:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Attempting to detach device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:41:35 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:41:35 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:41:35 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:41:35 user nova-compute[71347]:   <serial>a7da4ec7-6705-4f91-8c95-a082e8cc989b</serial>
Apr 14 14:41:35 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:41:35 user nova-compute[71347]: </disk>
Apr 14 14:41:35 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:41:35 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully detached device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the persistent domain config.
Apr 14 14:41:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47e05edc-4808-49de-b882-addd28b2258c from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:41:35 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:41:35 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:41:35 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:41:35 user nova-compute[71347]:   <serial>a7da4ec7-6705-4f91-8c95-a082e8cc989b</serial>
Apr 14 14:41:35 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:41:35 user nova-compute[71347]: </disk>
Apr 14 14:41:35 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681483295.8385744, 47e05edc-4808-49de-b882-addd28b2258c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:41:35 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully detached device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the live domain config.
Apr 14 14:41:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmdyufv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:41:35 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9b949-c7ef-4d5f-b6fd-da9b39b28ea8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:41:35 user nova-compute[71347]: No targets found.
Apr 14 14:41:35 user nova-compute[71347]: iSNS:
Apr 14 14:41:35 user nova-compute[71347]: No targets found.
Apr 14 14:41:35 user nova-compute[71347]: STATIC:
Apr 14 14:41:35 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b
Apr 14 14:41:35 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:41:35 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:41:35 user nova-compute[71347]: FIRMWARE:
Apr 14 14:41:35 user nova-compute[71347]: No targets found.
Apr 14 14:41:35 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:41:35 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:41:35 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dd40c4-f80b-4407-bd9b-9f0b26465fb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce9da9-3768-4507-a87b-6f6f2ac65ae4]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b (non-flash)
Apr 14 14:41:35 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b (non-flash)
Apr 14 14:41:35 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4b92c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2f6a54-4d79-48b6-a768-d59596e4f119]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b1ec5e-316b-423c-8b8d-1b64bc171117]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1073df-de77-49cf-8682-b1471b4c8250]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:41:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f48958-38e2-48b9-af71-7f55a6f726f5]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c95d0b-8e29-43a4-aad2-ddf534f3c702]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f4ee29-0bc4-4cb8-941d-07c9e1f88fdf]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b, portal: 172.16.0.220,3260]
Apr 14 14:41:36 user nova-compute[71347]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b, portal: 172.16.0.220,3260] successful.
Apr 14 14:41:36 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7da4ec7-6705-4f91-8c95-a082e8cc989b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4739b-b0a2-42a7-8c1b-98c694ef9973]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== disconnect_volume: return (306ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:36 user nova-compute[71347]: DEBUG nova.objects.instance [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'flavor' on Instance uuid 6952658d-8c9d-4359-9f90-04a35e6126a1 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:41:36 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Ignoring supplied device name: /dev/vdb
Apr 14 14:41:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG nova.objects.instance [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:41:37 user nova-compute[71347]: INFO nova.compute.manager [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Attaching volume 58650e08-b3bf-4fad-ba96-366d6bb19f6f to /dev/vdb
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-923c4637-7a97-478c-b288-abfd071adea2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.861s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG os_brick.utils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c0460-02f1-4ea2-9439-7bc8b34c86b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[140d2b89-6baa-486c-a4ec-a0b533e4ef4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[03153abd-b954-48b7-8e87-f5cb6e819241]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba208c0-1ed4-40b1-ab71-703c0148056f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:41:37 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:41:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a309561b-a03d-43e8-bce7-9372e56e6266]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG os_brick.utils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Updating existing volume attachment record: 9bc7106b-9d89-462f-bab8-31882a02cf15 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:41:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmfMcAHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:41:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:41:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:41:41 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2a7afd-afd7-4430-b228-79e6f8f3ec35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:41:41 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7914af-9835-4bcb-8e5e-beb13e5eb25d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f] added
Apr 14 14:41:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4277a5-8939-4f0c-bd97-6f8ec8f11923]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c4a3c-e1e9-400a-b579-a88ec0cd0887]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmfMcAHG {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmfMcAHG" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a65f7b-adce-4af3-8844-8b7661c41bba]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pmfMcAHG'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea30b9f-eef1-4621-90cd-7a3539185bb5]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52b7d62-aec7-4237-9004-cc0e1cfb7f7b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:41:41 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:41:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:41:41 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:41:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:41:41 user nova-compute[71347]: 
Apr 14 14:41:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4116c208-d945-445b-af11-4e66bc76af3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f, portal: 172.16.0.220,3260]
Apr 14 14:41:42 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f, portal: 172.16.0.220,3260] successful.
Apr 14 14:41:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91198cb-1639-4ed3-a379-bd6e68c8aed7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac7361-9d3a-47a5-9b3d-e059e2c57763]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f (non-flash)
Apr 14 14:41:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f (non-flash)
Apr 14 14:41:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dafb8a0-097a-4542-ada2-41b483b23df7]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:41:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmfMcAHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23761616132343066', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761616132343066', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG nova.objects.instance [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'flavor' on Instance uuid 6952658d-8c9d-4359-9f90-04a35e6126a1 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:41:43 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:41:43 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:41:43 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:41:43 user nova-compute[71347]:   <serial>58650e08-b3bf-4fad-ba96-366d6bb19f6f</serial>
Apr 14 14:41:43 user nova-compute[71347]: </disk>
Apr 14 14:41:43 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] No VIF found with MAC fa:16:3e:82:85:c4, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:41:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-119b8e7f-3e21-4c6d-8520-a29e7db8901c tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.606s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:41:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:41:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:41:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:01 user nova-compute[71347]: INFO nova.compute.manager [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Detaching volume 58650e08-b3bf-4fad-ba96-366d6bb19f6f
Apr 14 14:42:01 user nova-compute[71347]: INFO nova.virt.block_device [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Attempting to driver detach volume 58650e08-b3bf-4fad-ba96-366d6bb19f6f from mountpoint /dev/vdb
Apr 14 14:42:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Attempting to detach device vdb from instance 6952658d-8c9d-4359-9f90-04a35e6126a1 from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:42:01 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:42:01 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:42:01 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:42:01 user nova-compute[71347]:   <serial>58650e08-b3bf-4fad-ba96-366d6bb19f6f</serial>
Apr 14 14:42:01 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:42:01 user nova-compute[71347]: </disk>
Apr 14 14:42:01 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:42:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Successfully detached device vdb from instance 6952658d-8c9d-4359-9f90-04a35e6126a1 from the persistent domain config.
Apr 14 14:42:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6952658d-8c9d-4359-9f90-04a35e6126a1 from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:42:01 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:42:01 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:42:01 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:42:01 user nova-compute[71347]:   <serial>58650e08-b3bf-4fad-ba96-366d6bb19f6f</serial>
Apr 14 14:42:01 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:42:01 user nova-compute[71347]: </disk>
Apr 14 14:42:01 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681483321.70534, 6952658d-8c9d-4359-9f90-04a35e6126a1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6952658d-8c9d-4359-9f90-04a35e6126a1 {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:42:01 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Successfully detached device vdb from instance 6952658d-8c9d-4359-9f90-04a35e6126a1 from the live domain config.
Apr 14 14:42:01 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmfMcAHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:42:01 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee70553-b1f6-447d-a123-1348ffd27e63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:42:01 user nova-compute[71347]: No targets found.
Apr 14 14:42:01 user nova-compute[71347]: iSNS:
Apr 14 14:42:01 user nova-compute[71347]: No targets found.
Apr 14 14:42:01 user nova-compute[71347]: STATIC:
Apr 14 14:42:01 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f
Apr 14 14:42:01 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:42:01 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:42:01 user nova-compute[71347]: FIRMWARE:
Apr 14 14:42:01 user nova-compute[71347]: No targets found.
Apr 14 14:42:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:42:01 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:42:01 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d21935b-55f8-4a11-bcb5-ea184c78fc4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2604e8f9-04a0-4e97-b08d-be5b1a27bafc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f (non-flash)
Apr 14 14:42:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f (non-flash)
Apr 14 14:42:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5005620b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0274b6-9477-4e65-8c01-3a8b121160bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb16aad2-aded-40ba-870d-257700075ed0]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c79a8-fa55-477c-993c-6284893a2b47]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a48ab81-331b-484d-9620-e7ed599d9bc6]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0feb165-17e2-40b1-8746-a7c3952208f2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75015a0-d50d-479f-bd99-732c15738b7e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f, portal: 172.16.0.220,3260]
Apr 14 14:42:01 user nova-compute[71347]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f, portal: 172.16.0.220,3260] successful.
Apr 14 14:42:01 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:01 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f70655-809b-4da4-9efc-e4079952c273]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] <== disconnect_volume: return (292ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'flavor' on Instance uuid 6952658d-8c9d-4359-9f90-04a35e6126a1 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-5778f470-8436-47cb-8c84-3bf354c31d9e tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.532s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:02 user nova-compute[71347]: INFO nova.compute.manager [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Terminating instance
Apr 14 14:42:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received event network-vif-unplugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] No waiting events found dispatching network-vif-unplugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-28b11585-1921-4817-880b-c1f8492dd827 req-3272c333-0ce5-4809-b443-5242da6bf97a service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received event network-vif-unplugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:42:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Instance destroyed successfully.
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.objects.instance [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lazy-loading 'resources' on Instance uuid 6952658d-8c9d-4359-9f90-04a35e6126a1 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-404552932',display_name='tempest-VolumesSnapshotTestJSON-instance-404552932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-404552932',id=37,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:39:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fab35b3694734461828bb8bd19f4bc65',ramdisk_id='',reservation_id='r-08b6di2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1438289684',owner_user_name='tempest-VolumesSnapshotTestJSON-1438289684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:39:53Z,user_data=None,user_id='506ec17dec9149698ca687d2ce256acd',uuid=6952658d-8c9d-4359-9f90-04a35e6126a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converting VIF {"id": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "address": "fa:16:3e:82:85:c4", "network": {"id": "268bc296-0903-44c4-96c7-10ea6c7be910", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-851906459-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fab35b3694734461828bb8bd19f4bc65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f927ec3-3c", "ovs_interfaceid": "3f927ec3-3cdd-4128-89da-07d4ec7e02c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:c4,bridge_name='br-int',has_traffic_filtering=True,id=3f927ec3-3cdd-4128-89da-07d4ec7e02c9,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f927ec3-3c') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG os_vif [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:c4,bridge_name='br-int',has_traffic_filtering=True,id=3f927ec3-3cdd-4128-89da-07d4ec7e02c9,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f927ec3-3c') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f927ec3-3c, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:42:03 user nova-compute[71347]: INFO os_vif [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:c4,bridge_name='br-int',has_traffic_filtering=True,id=3f927ec3-3cdd-4128-89da-07d4ec7e02c9,network=Network(268bc296-0903-44c4-96c7-10ea6c7be910),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f927ec3-3c')
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:58650e08-b3bf-4fad-ba96-366d6bb19f6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmfMcAHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:42:03 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:42:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[81114ae8-bbe7-4e1c-b722-2ead9597c520]: Unexpected error while running command.
Apr 14 14:42:03 user nova-compute[71347]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 14:42:03 user nova-compute[71347]: Exit code: 21
Apr 14 14:42:03 user nova-compute[71347]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 14:42:03 user nova-compute[71347]: Stderr: '' {{(pid=82022) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 14:42:03 user nova-compute[71347]: Traceback (most recent call last):
Apr 14 14:42:03 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 14:42:03 user nova-compute[71347]:     ret = func(*f_args, **f_kwargs)
Apr 14 14:42:03 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 14:42:03 user nova-compute[71347]:     return func(*args, **kwargs)
Apr 14 14:42:03 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 14:42:03 user nova-compute[71347]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 14:42:03 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 14:42:03 user nova-compute[71347]:     return putils.execute(on_execute=on_execute,
Apr 14 14:42:03 user nova-compute[71347]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 14:42:03 user nova-compute[71347]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 14:42:03 user nova-compute[71347]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 14:42:03 user nova-compute[71347]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 14:42:03 user nova-compute[71347]: Exit code: 21
Apr 14 14:42:03 user nova-compute[71347]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 14:42:03 user nova-compute[71347]: Stderr: ''
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[81114ae8-bbe7-4e1c-b722-2ead9597c520]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 14:42:03 user nova-compute[71347]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 14:42:03 user nova-compute[71347]: Exit code: 21
Apr 14 14:42:03 user nova-compute[71347]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 14:42:03 user nova-compute[71347]: Stderr: ''
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 14:42:03 user nova-compute[71347]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 14:42:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71347) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.025s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] <== disconnect_volume: return (26ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:42:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Deleting instance files /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1_del
Apr 14 14:42:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Deletion of /opt/stack/data/nova/instances/6952658d-8c9d-4359-9f90-04a35e6126a1_del complete
Apr 14 14:42:03 user nova-compute[71347]: INFO nova.compute.manager [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 14:42:03 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:42:03 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:42:04 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:42:04 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Took 0.49 seconds to deallocate network for instance.
Apr 14 14:42:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-3648a9ea-46c0-4dc5-aed9-6addcfb9c591 req-3130b92a-898c-4e38-8f75-8a5ac29a9241 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received event network-vif-deleted-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:42:04 user nova-compute[71347]: WARNING nova.volume.cinder [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Attachment 9bc7106b-9d89-462f-bab8-31882a02cf15 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9bc7106b-9d89-462f-bab8-31882a02cf15. (HTTP 404) (Request-ID: req-4e7da7a3-3cde-4fad-a193-0028c4a036b0)
Apr 14 14:42:04 user nova-compute[71347]: INFO nova.compute.manager [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Took 0.02 seconds to detach 1 volumes for instance.
Apr 14 14:42:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:04 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:42:04 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:42:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:04 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Deleted allocations for instance 6952658d-8c9d-4359-9f90-04a35e6126a1
Apr 14 14:42:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-019a771f-42b2-48e5-a89f-5a3be3ace666 tempest-VolumesSnapshotTestJSON-1438289684 tempest-VolumesSnapshotTestJSON-1438289684-project-member] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.793s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received event network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:42:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] Acquiring lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] Lock "6952658d-8c9d-4359-9f90-04a35e6126a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:05 user nova-compute[71347]: DEBUG nova.compute.manager [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] No waiting events found dispatching network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:42:05 user nova-compute[71347]: WARNING nova.compute.manager [req-beea132e-39d3-4ff7-86de-1a412f416126 req-98fdd9db-dc3c-4479-8de2-fa104238f9c7 service nova] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Received unexpected event network-vif-plugged-3f927ec3-3cdd-4128-89da-07d4ec7e02c9 for instance with vm_state deleted and task_state None.
Apr 14 14:42:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:10 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:11 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:42:12 user nova-compute[71347]: INFO nova.compute.claims [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Claim successful on node user
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:42:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.policy [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:42:12 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Creating image(s)
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "/opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "/opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk 1073741824" returned: 0 in 0.049s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:12 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.128s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Successfully created port: 3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Cannot resize image /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG nova.objects.instance [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'migration_context' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Successfully updated port: 3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received event network-changed-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Refreshing instance network info cache due to event network-changed-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Instance network_info: |[{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Refreshing network info cache for port 3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Start _get_guest_xml network_info=[{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:42:14 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:42:14 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-682419594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-682419594',id=38,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-og0u4y0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:42:12Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=2bf7382e-7ffd-4f89-8b79-e8616462c61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1f:ea,bridge_name='br-int',has_traffic_filtering=True,id=3e411066-1ad2-4ba8-a60e-ad0c8cea8a40,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e411066-1a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.objects.instance [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:42:14 user nova-compute[71347]:   <uuid>2bf7382e-7ffd-4f89-8b79-e8616462c61b</uuid>
Apr 14 14:42:14 user nova-compute[71347]:   <name>instance-00000026</name>
Apr 14 14:42:14 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:42:14 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:42:14 user nova-compute[71347]:   <metadata>
Apr 14 14:42:14 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:42:14 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:42:14 user nova-compute[71347]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-682419594</nova:name>
Apr 14 14:42:14 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:42:14</nova:creationTime>
Apr 14 14:42:14 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:42:14 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:42:14 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:42:14 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:42:14 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:42:14 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:42:14 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:42:14 user nova-compute[71347]:       <nova:owner>
Apr 14 14:42:14 user nova-compute[71347]:         <nova:user uuid="2e321f85d3d44c2baf210a1962f4f08f">tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member</nova:user>
Apr 14 14:42:14 user nova-compute[71347]:         <nova:project uuid="2241300ad3704734aed3990cc7aadc1b">tempest-ServerBootFromVolumeStableRescueTest-2086147649</nova:project>
Apr 14 14:42:14 user nova-compute[71347]:       </nova:owner>
Apr 14 14:42:14 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:42:14 user nova-compute[71347]:       <nova:ports>
Apr 14 14:42:14 user nova-compute[71347]:         <nova:port uuid="3e411066-1ad2-4ba8-a60e-ad0c8cea8a40">
Apr 14 14:42:14 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 14:42:14 user nova-compute[71347]:         </nova:port>
Apr 14 14:42:14 user nova-compute[71347]:       </nova:ports>
Apr 14 14:42:14 user nova-compute[71347]:     </nova:instance>
Apr 14 14:42:14 user nova-compute[71347]:   </metadata>
Apr 14 14:42:14 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:42:14 user nova-compute[71347]:     <system>
Apr 14 14:42:14 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:42:14 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:42:14 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:42:14 user nova-compute[71347]:       <entry name="serial">2bf7382e-7ffd-4f89-8b79-e8616462c61b</entry>
Apr 14 14:42:14 user nova-compute[71347]:       <entry name="uuid">2bf7382e-7ffd-4f89-8b79-e8616462c61b</entry>
Apr 14 14:42:14 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:42:14 user nova-compute[71347]:     </system>
Apr 14 14:42:14 user nova-compute[71347]:   </sysinfo>
Apr 14 14:42:14 user nova-compute[71347]:   <os>
Apr 14 14:42:14 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:42:14 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:42:14 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:42:14 user nova-compute[71347]:   </os>
Apr 14 14:42:14 user nova-compute[71347]:   <features>
Apr 14 14:42:14 user nova-compute[71347]:     <acpi/>
Apr 14 14:42:14 user nova-compute[71347]:     <apic/>
Apr 14 14:42:14 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:42:14 user nova-compute[71347]:   </features>
Apr 14 14:42:14 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:42:14 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:42:14 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:42:14 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:42:14 user nova-compute[71347]:   </clock>
Apr 14 14:42:14 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:42:14 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:42:14 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:42:14 user nova-compute[71347]:   </cpu>
Apr 14 14:42:14 user nova-compute[71347]:   <devices>
Apr 14 14:42:14 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:42:14 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:42:14 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk"/>
Apr 14 14:42:14 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:42:14 user nova-compute[71347]:     </disk>
Apr 14 14:42:14 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:42:14 user nova-compute[71347]:       <mac address="fa:16:3e:29:1f:ea"/>
Apr 14 14:42:14 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:42:14 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:42:14 user nova-compute[71347]:       <target dev="tap3e411066-1a"/>
Apr 14 14:42:14 user nova-compute[71347]:     </interface>
Apr 14 14:42:14 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:42:14 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/console.log" append="off"/>
Apr 14 14:42:14 user nova-compute[71347]:     </serial>
Apr 14 14:42:14 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:42:14 user nova-compute[71347]:     <video>
Apr 14 14:42:14 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:42:14 user nova-compute[71347]:     </video>
Apr 14 14:42:14 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:42:14 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:42:14 user nova-compute[71347]:     </rng>
Apr 14 14:42:14 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:42:14 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:42:14 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:42:14 user nova-compute[71347]:     </memballoon>
Apr 14 14:42:14 user nova-compute[71347]:   </devices>
Apr 14 14:42:14 user nova-compute[71347]: </domain>
Apr 14 14:42:14 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-682419594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-682419594',id=38,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-og0u4y0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:42:12Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=2bf7382e-7ffd-4f89-8b79-e8616462c61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1f:ea,bridge_name='br-int',has_traffic_filtering=True,id=3e411066-1ad2-4ba8-a60e-ad0c8cea8a40,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e411066-1a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG os_vif [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1f:ea,bridge_name='br-int',has_traffic_filtering=True,id=3e411066-1ad2-4ba8-a60e-ad0c8cea8a40,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e411066-1a') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e411066-1a, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e411066-1a, col_values=(('external_ids', {'iface-id': '3e411066-1ad2-4ba8-a60e-ad0c8cea8a40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:1f:ea', 'vm-uuid': '2bf7382e-7ffd-4f89-8b79-e8616462c61b'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:14 user nova-compute[71347]: INFO os_vif [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1f:ea,bridge_name='br-int',has_traffic_filtering=True,id=3e411066-1ad2-4ba8-a60e-ad0c8cea8a40,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e411066-1a')
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No VIF found with MAC fa:16:3e:29:1f:ea, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updated VIF entry in instance network info cache for port 3e411066-1ad2-4ba8-a60e-ad0c8cea8a40. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG nova.network.neutron [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:42:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b05ffc5-3857-4a6c-9ee1-4ebeaf517619 req-4dc42bd2-742e-442f-af6c-8188120f6237 service nova] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:42:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received event network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] No waiting events found dispatching network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:42:16 user nova-compute[71347]: WARNING nova.compute.manager [req-ed2e0c54-8916-4fe9-a387-03310d8c221a req-e3d48890-d104-4676-b5e5-5bfb10ad6e73 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received unexpected event network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance with vm_state building and task_state spawning.
Apr 14 14:42:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:16 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:42:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:17 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483337.992079, 2bf7382e-7ffd-4f89-8b79-e8616462c61b => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:42:18 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] VM Resumed (Lifecycle Event)
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:42:18 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:42:18 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=26.443401336669922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:18 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Instance spawned successfully.
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:42:18 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483337.9934447, 2bf7382e-7ffd-4f89-8b79-e8616462c61b => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:42:18 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] VM Started (Lifecycle Event)
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 47e05edc-4808-49de-b882-addd28b2258c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:42:18 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:42:18 user nova-compute[71347]: INFO nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Took 5.64 seconds to spawn the instance on the hypervisor.
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received event network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] No waiting events found dispatching network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:42:18 user nova-compute[71347]: WARNING nova.compute.manager [req-16617701-7134-407b-970b-23010980efe9 req-a01e6d98-3dd0-46f8-a587-6ff099af6c73 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received unexpected event network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance with vm_state building and task_state spawning.
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:42:18 user nova-compute[71347]: INFO nova.compute.manager [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Took 6.18 seconds to build instance.
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-91aa40c4-585c-4275-899d-7212d9ab9742 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.287s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483323.6451883, 6952658d-8c9d-4359-9f90-04a35e6126a1 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:42:18 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] VM Stopped (Lifecycle Event)
Apr 14 14:42:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-20189a4d-db02-420a-89b9-1f2a030f7e86 None None] [instance: 6952658d-8c9d-4359-9f90-04a35e6126a1] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:42:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:42:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:42:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:42:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:29 user nova-compute[71347]: INFO nova.compute.manager [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attaching volume f7aea457-6857-44f9-a3bf-0a76f58ba06e to /dev/vdb
Apr 14 14:42:29 user nova-compute[71347]: DEBUG os_brick.utils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ebeed-eb17-4bc0-a6f2-7696747ccb4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[644efece-91a3-44a0-938f-21750fb3f69d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3256084d-bbd4-4a2b-b135-8a8c3dd0a030]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[63babac0-80d5-49d6-a511-8b66f82774fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:42:29 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:42:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bee4d4-471c-471e-aee0-98e69ab8d68e]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG os_brick.utils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating existing volume attachment record: 84f9d88b-b8a5-43cb-8f59-ca5e27c8d9ce {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:42:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:42:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEvzmnAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:42:33 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:42:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:42:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:42:33 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:42:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:42:33 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:42:33 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:42:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfec574-ba57-4713-b8ae-018457b3c7ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:42:34 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[58287c40-a876-4dd0-b97b-971e51714626]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e] added
Apr 14 14:42:34 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d726d949-6fce-41c4-9be1-5276d1a11a39]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad8e97b-5da2-44f3-ac90-e12ee4a64cd7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QEvzmnAW {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QEvzmnAW" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5dbacb-29b4-46c8-a735-4a0520006c08]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QEvzmnAW'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7db200-6e3e-4ad9-909b-c46642d7ecb9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[84630d81-3229-46ea-b762-e991b3d5a576]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:42:34 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:42:34 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:42:34 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:42:34 user nova-compute[71347]: 
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[47338312-71b4-494d-a5dd-08b906986232]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e, portal: 172.16.0.220,3260]
Apr 14 14:42:34 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e, portal: 172.16.0.220,3260] successful.
Apr 14 14:42:34 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c59910b-5ce6-4980-ac42-a0bd27281832]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7214c-04c6-4fc4-9968-1f8cea2ed2c9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e (non-flash)
Apr 14 14:42:34 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e (non-flash)
Apr 14 14:42:34 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a549b541-5ea7-4232-8901-ce8efb3ffa46]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEvzmnAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:42:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:42:35 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23136643630663538', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:42:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136643630663538', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:42:35 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:42:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:42:35 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:42:35 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:42:35 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:42:35 user nova-compute[71347]:   <serial>f7aea457-6857-44f9-a3bf-0a76f58ba06e</serial>
Apr 14 14:42:35 user nova-compute[71347]: </disk>
Apr 14 14:42:35 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:42:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:42:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:42:35 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No VIF found with MAC fa:16:3e:96:55:a8, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:42:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b3643872-9085-473c-ac13-3a2c44a49556 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.761s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:42:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:42:37 user nova-compute[71347]: INFO nova.compute.manager [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Detaching volume f7aea457-6857-44f9-a3bf-0a76f58ba06e
Apr 14 14:42:37 user nova-compute[71347]: INFO nova.virt.block_device [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attempting to driver detach volume f7aea457-6857-44f9-a3bf-0a76f58ba06e from mountpoint /dev/vdb
Apr 14 14:42:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Attempting to detach device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:42:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:42:37 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:42:37 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:42:37 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:42:37 user nova-compute[71347]:   <serial>f7aea457-6857-44f9-a3bf-0a76f58ba06e</serial>
Apr 14 14:42:37 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:42:37 user nova-compute[71347]: </disk>
Apr 14 14:42:37 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:42:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully detached device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the persistent domain config.
Apr 14 14:42:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47e05edc-4808-49de-b882-addd28b2258c from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:42:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:42:37 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:42:37 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:42:37 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:42:37 user nova-compute[71347]:   <serial>f7aea457-6857-44f9-a3bf-0a76f58ba06e</serial>
Apr 14 14:42:37 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:42:37 user nova-compute[71347]: </disk>
Apr 14 14:42:37 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681483358.3498356, 47e05edc-4808-49de-b882-addd28b2258c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:42:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully detached device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the live domain config.
Apr 14 14:42:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QEvzmnAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:42:38 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[62837aa8-a4dd-42b8-a832-c420735f26b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:42:38 user nova-compute[71347]: No targets found.
Apr 14 14:42:38 user nova-compute[71347]: iSNS:
Apr 14 14:42:38 user nova-compute[71347]: No targets found.
Apr 14 14:42:38 user nova-compute[71347]: STATIC:
Apr 14 14:42:38 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e
Apr 14 14:42:38 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:42:38 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:42:38 user nova-compute[71347]: FIRMWARE:
Apr 14 14:42:38 user nova-compute[71347]: No targets found.
Apr 14 14:42:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:42:38 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:42:38 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee8aade-d690-425a-8371-f430e0f78441]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2d0e44-af93-47c4-b160-f3bd784356cb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e (non-flash)
Apr 14 14:42:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e (non-flash)
Apr 14 14:42:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4b92b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f44478-b571-4b56-93bc-01617e7558a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[42763c42-baaa-4bab-8ef5-c88218218d57]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a93fa-0a77-499d-8bc0-c35686f99597]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a8377e-3368-460a-91d7-72ed202bab82]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddad72b-e215-4273-870f-48dd544bb102]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c393b6b2-c0dc-45c1-aa94-2373c8c78ce0]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e, portal: 172.16.0.220,3260]
Apr 14 14:42:38 user nova-compute[71347]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e, portal: 172.16.0.220,3260] successful.
Apr 14 14:42:38 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7aea457-6857-44f9-a3bf-0a76f58ba06e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f240d42-b722-40a8-9cd6-12b1ab88ef81]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== disconnect_volume: return (273ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:42:38 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:42:39 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:42:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2c7ab1f7-d6b8-4c1b-b1e8-070aecc2262f tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.738s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:42:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:42:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:42:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:42:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:43:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:12 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:43:17 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:17 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:43:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:43:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:43:17 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:43:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:19 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:43:19 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=26.421833038330078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 47e05edc-4808-49de-b882-addd28b2258c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:43:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:43:20 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:43:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:43:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:43:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:43:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:43:21 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:43:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating instance_info_cache with network_info: [{"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:43:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:43:21 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:43:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:24 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:43:34 user nova-compute[71347]: INFO nova.compute.manager [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attaching volume 73f6fe76-390b-42d8-bf92-7b5c4768515b to /dev/vdb
Apr 14 14:43:34 user nova-compute[71347]: DEBUG os_brick.utils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98d0481-30c4-4b3d-9a4d-a28f11a2784d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[63214b8b-28db-4db2-a7e1-9c087fef7429]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3d00bf-0012-4d11-8b58-54cebc1401e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b15f455-59ae-4859-a2b8-8fa400c02c82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:43:34 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:43:34 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05bf8de-f70c-4b75-83c5-90f395f13ab9]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG os_brick.utils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating existing volume attachment record: 19a7d099-45d4-4d9f-9c52-6866865d87b9 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:43:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPZGomOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:43:42 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:43:42 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:43:42 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efb4d90-5137-4fca-8dc9-3d0be38bbfc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:43:42 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae977d-aa99-4a21-99b2-6ee827ae9a64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b] added
Apr 14 14:43:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cb8f01-6d59-4cb6-9c17-5fc044fa496b]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a38670-edbd-4fa1-b3d4-7df80c4d5b42]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPZGomOs {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPZGomOs" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3f9a4-722a-4663-9f1b-3d9e99534bf6]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPZGomOs'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c31608-a976-4ab1-be8f-f9aca27b5df9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c3719-e9df-4198-b036-9d5db102bfcc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:43:42 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:43:42 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:43:42 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:43:42 user nova-compute[71347]: 
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c72233-2f4e-4f02-ad9f-743da88f2f47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b, portal: 172.16.0.220,3260]
Apr 14 14:43:42 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b, portal: 172.16.0.220,3260] successful.
Apr 14 14:43:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a2e75-e8d9-445e-a13b-c1fa057ee638]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2787d9-898a-4ffa-b931-45a351c23fea]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b (non-flash)
Apr 14 14:43:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b (non-flash)
Apr 14 14:43:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[26102e1f-0c66-455f-ad04-a8df08eff215]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:43:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPZGomOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:43:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:43:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23537613564313937', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:43:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537613564313937', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:43:43 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:43:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 14:43:43 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:43:43 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:43:43 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:43:43 user nova-compute[71347]:   <serial>73f6fe76-390b-42d8-bf92-7b5c4768515b</serial>
Apr 14 14:43:43 user nova-compute[71347]: </disk>
Apr 14 14:43:43 user nova-compute[71347]:  {{(pid=71347) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 14:43:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:43:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:43:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] No VIF found with MAC fa:16:3e:96:55:a8, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:43:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fb65610a-fdd4-4b5f-8f0c-62d105d40123 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.998s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:43:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:43:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:43:45 user nova-compute[71347]: INFO nova.compute.manager [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Detaching volume 73f6fe76-390b-42d8-bf92-7b5c4768515b
Apr 14 14:43:45 user nova-compute[71347]: INFO nova.virt.block_device [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Attempting to driver detach volume 73f6fe76-390b-42d8-bf92-7b5c4768515b from mountpoint /dev/vdb
Apr 14 14:43:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Attempting to detach device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the persistent domain config. {{(pid=71347) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 14:43:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:43:45 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:43:45 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:43:45 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:43:45 user nova-compute[71347]:   <serial>73f6fe76-390b-42d8-bf92-7b5c4768515b</serial>
Apr 14 14:43:45 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:43:45 user nova-compute[71347]: </disk>
Apr 14 14:43:45 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:43:45 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully detached device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the persistent domain config.
Apr 14 14:43:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47e05edc-4808-49de-b882-addd28b2258c from the live domain config. {{(pid=71347) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 14:43:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 14:43:45 user nova-compute[71347]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:43:45 user nova-compute[71347]:   <source dev="/dev/sdb"/>
Apr 14 14:43:45 user nova-compute[71347]:   <target dev="vdb" bus="virtio"/>
Apr 14 14:43:45 user nova-compute[71347]:   <serial>73f6fe76-390b-42d8-bf92-7b5c4768515b</serial>
Apr 14 14:43:45 user nova-compute[71347]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 14:43:45 user nova-compute[71347]: </disk>
Apr 14 14:43:45 user nova-compute[71347]:  {{(pid=71347) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Received event <DeviceRemovedEvent: 1681483426.383597, 47e05edc-4808-49de-b882-addd28b2258c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71347) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 14:43:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully detached device vdb from instance 47e05edc-4808-49de-b882-addd28b2258c from the live domain config.
Apr 14 14:43:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPZGomOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:43:46 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0342b63-fa28-4aee-bb96-8c2c0e30986a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:43:46 user nova-compute[71347]: No targets found.
Apr 14 14:43:46 user nova-compute[71347]: iSNS:
Apr 14 14:43:46 user nova-compute[71347]: No targets found.
Apr 14 14:43:46 user nova-compute[71347]: STATIC:
Apr 14 14:43:46 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b
Apr 14 14:43:46 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:43:46 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:43:46 user nova-compute[71347]: FIRMWARE:
Apr 14 14:43:46 user nova-compute[71347]: No targets found.
Apr 14 14:43:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:43:46 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:43:46 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e1b38-0351-471f-bd6c-4b66676d3c91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e48ca2-1131-4bf6-bc08-21941907b280]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b (non-flash)
Apr 14 14:43:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b (non-flash)
Apr 14 14:43:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd8142290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf3b57f-1b00-4afa-8b8d-0df9e038bc25]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac55536-ab97-41db-97c0-9f11f123c7fe]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6480acff-e605-4977-8d25-1f390a36d79a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c9c21c-2b08-4308-b578-93ff82e92083]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[af21b2ec-0be2-412b-b635-15656f6d5912]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90e6d76-d3f9-4673-8065-faf607cf0933]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b, portal: 172.16.0.220,3260]
Apr 14 14:43:46 user nova-compute[71347]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b, portal: 172.16.0.220,3260] successful.
Apr 14 14:43:46 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f6fe76-390b-42d8-bf92-7b5c4768515b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a5524-9743-4247-9123-d5a3d37a79c7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] <== disconnect_volume: return (280ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:43:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:43:48 user nova-compute[71347]: DEBUG nova.objects.instance [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'flavor' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:43:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ae26068-c27f-4069-9b0a-124ff99602c2 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.733s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:43:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:43:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:43:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG nova.compute.manager [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:44:03 user nova-compute[71347]: INFO nova.compute.manager [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] instance snapshotting
Apr 14 14:44:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Beginning live snapshot process
Apr 14 14:44:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json -f qcow2 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json -f qcow2 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdtgui5e_/6aa779a91c394aa4aa9f98ea575209af.delta 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdtgui5e_/6aa779a91c394aa4aa9f98ea575209af.delta 1073741824" returned: 0 in 0.050s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:03 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 14:44:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:44:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:05 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:44:05 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 14:44:05 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:44:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdtgui5e_/6aa779a91c394aa4aa9f98ea575209af.delta /opt/stack/data/nova/instances/snapshots/tmpdtgui5e_/6aa779a91c394aa4aa9f98ea575209af {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:05 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdtgui5e_/6aa779a91c394aa4aa9f98ea575209af.delta /opt/stack/data/nova/instances/snapshots/tmpdtgui5e_/6aa779a91c394aa4aa9f98ea575209af" returned: 0 in 0.374s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:05 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Snapshot extracted, beginning image upload
Apr 14 14:44:06 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:44:06 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:44:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:06 user nova-compute[71347]: INFO nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] During sync_power_state the instance has a pending task (image_uploading). Skip.
Apr 14 14:44:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:07 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Snapshot image upload complete
Apr 14 14:44:07 user nova-compute[71347]: INFO nova.compute.manager [None req-61fe474a-8901-490e-8745-19cbf9077773 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Took 4.83 seconds to snapshot the instance on the hypervisor.
Apr 14 14:44:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:14 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:18 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:18 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:20 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:44:20 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8603MB free_disk=26.382495880126953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 47e05edc-4808-49de-b882-addd28b2258c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "26d4aa8c-3e3b-4988-9876-1538edd88744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.035s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:44:20 user nova-compute[71347]: INFO nova.compute.claims [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Claim successful on node user
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.network.neutron [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:44:20 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.policy [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:44:20 user nova-compute[71347]: DEBUG nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:44:20 user nova-compute[71347]: INFO nova.virt.block_device [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Booting with volume snapshot 058b21a0-7ad7-4dc9-ac26-a3d07b607152 at /dev/vda
Apr 14 14:44:21 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:21 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:21 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:44:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Successfully created port: 27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:44:21 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:21 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:44:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:44:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:44:21 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Successfully updated port: 27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "refresh_cache-26d4aa8c-3e3b-4988-9876-1538edd88744" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquired lock "refresh_cache-26d4aa8c-3e3b-4988-9876-1538edd88744" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.compute.manager [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received event network-changed-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.compute.manager [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Refreshing instance network info cache due to event network-changed-27658df0-382a-404b-afde-a2f3f50eeeb2. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] Acquiring lock "refresh_cache-26d4aa8c-3e3b-4988-9876-1538edd88744" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.network.neutron [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Updating instance_info_cache with network_info: [{"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Releasing lock "refresh_cache-26d4aa8c-3e3b-4988-9876-1538edd88744" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Instance network_info: |[{"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] Acquired lock "refresh_cache-26d4aa8c-3e3b-4988-9876-1538edd88744" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.network.neutron [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Refreshing network info cache for port 27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.network.neutron [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Updated VIF entry in instance network info cache for port 27658df0-382a-404b-afde-a2f3f50eeeb2. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG nova.network.neutron [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Updating instance_info_cache with network_info: [{"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:44:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b6937297-52aa-446a-897d-151bddecc639 req-d0d3a398-9138-43b4-94e9-78adfba98c8d service nova] Releasing lock "refresh_cache-26d4aa8c-3e3b-4988-9876-1538edd88744" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:44:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:24 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:25 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG os_brick.utils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0485f64d-9c14-41ff-9501-5bfaaf6d2d8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[18def24b-2684-4265-b458-4ff5ca8b58df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47c7971-8d28-4226-a166-b2b739a9b436]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ba444-e5fd-4b08-9168-0c33d050948f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:44:26 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:44:26 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85efa38-e6b0-4812-851c-4d4639e16753]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG os_brick.utils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:44:26 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Updating existing volume attachment record: b48f92b8-3f5a-4abc-83fe-75770e2e5bec {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:44:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:44:31 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Creating image(s)
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Ensure instance console log exists: /opt/stack/data/nova/instances/26d4aa8c-3e3b-4988-9876-1538edd88744/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Start _get_guest_xml network_info=[{"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuYdVXNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26d4aa8c-3e3b-4988-9876-1538edd88744', 'attached_at': '', 'detached_at': '', 'volume_id': '561ea471-b5ab-4748-8953-c5d40f67af45', 'serial': '561ea471-b5ab-4748-8953-c5d40f67af45'}, 'attachment_id': 'b48f92b8-3f5a-4abc-83fe-75770e2e5bec', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:44:31 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:44:31 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuYdVXNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:44:31 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:44:31 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:44:31 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8278142-5b1a-48b1-bae9-18586a01eddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:44:31 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f823a212-2edc-40cc-a22e-e2a3f76e3c0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45] added
Apr 14 14:44:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f43694-fcfa-4abe-919a-5df10225df8c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[835a9f4f-ef34-4ae3-a687-b5c79d7527c0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuYdVXNj {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuYdVXNj" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cafac06-f01c-46cd-b9b9-d836508e5611]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SuYdVXNj'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0384bb-3233-4e34-80f2-fb4a8f433d8f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbf96c8-5b7a-48a6-82e8-05a4cfe91e10]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:44:31 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 14:44:31 user nova-compute[71347]:  {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:44:31 user nova-compute[71347]: WARNING os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 14:44:31 user nova-compute[71347]: 
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15103bb-19cc-44c9-8a9b-06d0f9783c47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45, portal: 172.16.0.220,3260]
Apr 14 14:44:31 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45, portal: 172.16.0.220,3260] successful.
Apr 14 14:44:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f321a37b-311d-4364-9e82-3a1966999d08]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddd87c6-0701-40f0-99b9-d02be8e971ac]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)
Apr 14 14:44:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)
Apr 14 14:44:31 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9a086e-73de-433b-84a0-e0e58cfc20b5]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:44:31 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuYdVXNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23233613833653236', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233613833653236', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1057433537',display_name='tempest-TestVolumeBootPattern-server-1057433537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1057433537',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-mscn65ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:44:21Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=26d4aa8c-3e3b-4988-9876-1538edd88744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b0,bridge_name='br-int',has_traffic_filtering=True,id=27658df0-382a-404b-afde-a2f3f50eeeb2,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27658df0-38') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.objects.instance [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'pci_devices' on Instance uuid 26d4aa8c-3e3b-4988-9876-1538edd88744 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:44:32 user nova-compute[71347]:   <uuid>26d4aa8c-3e3b-4988-9876-1538edd88744</uuid>
Apr 14 14:44:32 user nova-compute[71347]:   <name>instance-00000027</name>
Apr 14 14:44:32 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:44:32 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:44:32 user nova-compute[71347]:   <metadata>
Apr 14 14:44:32 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:44:32 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:44:32 user nova-compute[71347]:       <nova:name>tempest-TestVolumeBootPattern-server-1057433537</nova:name>
Apr 14 14:44:32 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:44:31</nova:creationTime>
Apr 14 14:44:32 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:44:32 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:44:32 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:44:32 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:44:32 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:44:32 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:44:32 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:44:32 user nova-compute[71347]:       <nova:owner>
Apr 14 14:44:32 user nova-compute[71347]:         <nova:user uuid="43b5d8526a7c4b0fb5f15a8345b229e2">tempest-TestVolumeBootPattern-152189831-project-member</nova:user>
Apr 14 14:44:32 user nova-compute[71347]:         <nova:project uuid="e217ba6818e94879aa02015ccf21b058">tempest-TestVolumeBootPattern-152189831</nova:project>
Apr 14 14:44:32 user nova-compute[71347]:       </nova:owner>
Apr 14 14:44:32 user nova-compute[71347]:       <nova:ports>
Apr 14 14:44:32 user nova-compute[71347]:         <nova:port uuid="27658df0-382a-404b-afde-a2f3f50eeeb2">
Apr 14 14:44:32 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 14:44:32 user nova-compute[71347]:         </nova:port>
Apr 14 14:44:32 user nova-compute[71347]:       </nova:ports>
Apr 14 14:44:32 user nova-compute[71347]:     </nova:instance>
Apr 14 14:44:32 user nova-compute[71347]:   </metadata>
Apr 14 14:44:32 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:44:32 user nova-compute[71347]:     <system>
Apr 14 14:44:32 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:44:32 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:44:32 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:44:32 user nova-compute[71347]:       <entry name="serial">26d4aa8c-3e3b-4988-9876-1538edd88744</entry>
Apr 14 14:44:32 user nova-compute[71347]:       <entry name="uuid">26d4aa8c-3e3b-4988-9876-1538edd88744</entry>
Apr 14 14:44:32 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:44:32 user nova-compute[71347]:     </system>
Apr 14 14:44:32 user nova-compute[71347]:   </sysinfo>
Apr 14 14:44:32 user nova-compute[71347]:   <os>
Apr 14 14:44:32 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:44:32 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:44:32 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:44:32 user nova-compute[71347]:   </os>
Apr 14 14:44:32 user nova-compute[71347]:   <features>
Apr 14 14:44:32 user nova-compute[71347]:     <acpi/>
Apr 14 14:44:32 user nova-compute[71347]:     <apic/>
Apr 14 14:44:32 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:44:32 user nova-compute[71347]:   </features>
Apr 14 14:44:32 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:44:32 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:44:32 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:44:32 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:44:32 user nova-compute[71347]:   </clock>
Apr 14 14:44:32 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:44:32 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:44:32 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:44:32 user nova-compute[71347]:   </cpu>
Apr 14 14:44:32 user nova-compute[71347]:   <devices>
Apr 14 14:44:32 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:44:32 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:44:32 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:44:32 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:44:32 user nova-compute[71347]:       <serial>561ea471-b5ab-4748-8953-c5d40f67af45</serial>
Apr 14 14:44:32 user nova-compute[71347]:     </disk>
Apr 14 14:44:32 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:44:32 user nova-compute[71347]:       <mac address="fa:16:3e:05:c5:b0"/>
Apr 14 14:44:32 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:44:32 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:44:32 user nova-compute[71347]:       <target dev="tap27658df0-38"/>
Apr 14 14:44:32 user nova-compute[71347]:     </interface>
Apr 14 14:44:32 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:44:32 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/26d4aa8c-3e3b-4988-9876-1538edd88744/console.log" append="off"/>
Apr 14 14:44:32 user nova-compute[71347]:     </serial>
Apr 14 14:44:32 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:44:32 user nova-compute[71347]:     <video>
Apr 14 14:44:32 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:44:32 user nova-compute[71347]:     </video>
Apr 14 14:44:32 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:44:32 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:44:32 user nova-compute[71347]:     </rng>
Apr 14 14:44:32 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:44:32 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:44:32 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:44:32 user nova-compute[71347]:     </memballoon>
Apr 14 14:44:32 user nova-compute[71347]:   </devices>
Apr 14 14:44:32 user nova-compute[71347]: </domain>
Apr 14 14:44:32 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1057433537',display_name='tempest-TestVolumeBootPattern-server-1057433537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1057433537',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-mscn65ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:44:21Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=26d4aa8c-3e3b-4988-9876-1538edd88744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b0,bridge_name='br-int',has_traffic_filtering=True,id=27658df0-382a-404b-afde-a2f3f50eeeb2,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27658df0-38') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG os_vif [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b0,bridge_name='br-int',has_traffic_filtering=True,id=27658df0-382a-404b-afde-a2f3f50eeeb2,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27658df0-38') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27658df0-38, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27658df0-38, col_values=(('external_ids', {'iface-id': '27658df0-382a-404b-afde-a2f3f50eeeb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:c5:b0', 'vm-uuid': '26d4aa8c-3e3b-4988-9876-1538edd88744'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:32 user nova-compute[71347]: INFO os_vif [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b0,bridge_name='br-int',has_traffic_filtering=True,id=27658df0-382a-404b-afde-a2f3f50eeeb2,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27658df0-38')
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:44:32 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No VIF found with MAC fa:16:3e:05:c5:b0, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:44:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received event network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:44:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] Acquiring lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:34 user nova-compute[71347]: DEBUG nova.compute.manager [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] No waiting events found dispatching network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:44:34 user nova-compute[71347]: WARNING nova.compute.manager [req-3b29f11f-4abc-4841-aa1e-67aebc60757f req-f36b9e5f-b25e-490e-9465-e26e8fad23e5 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received unexpected event network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 for instance with vm_state building and task_state spawning.
Apr 14 14:44:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received event network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] Acquiring lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] No waiting events found dispatching network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:44:36 user nova-compute[71347]: WARNING nova.compute.manager [req-9a6dbe4f-6179-42f6-bd63-68989ee473c9 req-1eb55146-6701-4c8c-a9ae-fe77ff781ab9 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received unexpected event network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 for instance with vm_state building and task_state spawning.
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483476.1872084, 26d4aa8c-3e3b-4988-9876-1538edd88744 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:44:36 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] VM Resumed (Lifecycle Event)
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:44:36 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Instance spawned successfully.
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:44:36 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483476.1893747, 26d4aa8c-3e3b-4988-9876-1538edd88744 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:44:36 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] VM Started (Lifecycle Event)
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:44:36 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:44:36 user nova-compute[71347]: INFO nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Took 5.18 seconds to spawn the instance on the hypervisor.
Apr 14 14:44:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:44:36 user nova-compute[71347]: INFO nova.compute.manager [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Took 16.23 seconds to build instance.
Apr 14 14:44:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-da53da43-86e7-4e16-82ac-ef6aff0c07c8 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.340s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:44:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-changed-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:44:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Refreshing instance network info cache due to event network-changed-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:44:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] Acquiring lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:44:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] Acquired lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:44:56 user nova-compute[71347]: DEBUG nova.network.neutron [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Refreshing network info cache for port 7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:44:57 user nova-compute[71347]: DEBUG nova.network.neutron [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updated VIF entry in instance network info cache for port 7aae5c21-3ca3-43da-b71b-643dd8e5e0b4. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:44:57 user nova-compute[71347]: DEBUG nova.network.neutron [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating instance_info_cache with network_info: [{"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:44:57 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9a6dac4e-678d-434c-97ac-b3958fc7b05b req-5b6a1118-d60f-4da7-80d0-33438dc9a516 service nova] Releasing lock "refresh_cache-47e05edc-4808-49de-b882-addd28b2258c" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:44:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:44:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:00 user nova-compute[71347]: INFO nova.compute.manager [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Terminating instance
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-unplugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] No waiting events found dispatching network-vif-unplugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-8dc4ff61-3c7c-45e4-9390-b6bcfd00e42e req-a0fff56b-fb86-43d8-b653-165e288055af service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-unplugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Instance destroyed successfully.
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.objects.instance [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lazy-loading 'resources' on Instance uuid 47e05edc-4808-49de-b882-addd28b2258c {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:38:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-339073380',display_name='tempest-SnapshotDataIntegrityTests-server-339073380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-339073380',id=36,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7cIH1GZq6di6+vECSTkynzLyyQ4iF/syoG1Wnz59qzkvk92HgogkMiVVvqKQ3/nkZ7p9Z3+4WCrJpgsbLPZHWBqsEzriBSLJeFWbatAbQlS/vMoGazryQ645/UCjugZQ==',key_name='tempest-SnapshotDataIntegrityTests-2051732308',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10efa412c2174b31bf584dc011340328',ramdisk_id='',reservation_id='r-xbmjyzqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1043128591',owner_user_name='tempest-SnapshotDataIntegrityTests-1043128591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:38:23Z,user_data=None,user_id='aa6e905bd6cd4a3ab3c59888a5ee273e',uuid=47e05edc-4808-49de-b882-addd28b2258c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Converting VIF {"id": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "address": "fa:16:3e:96:55:a8", "network": {"id": "16b3fb2e-3da2-401b-a4ea-924cf059c727", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-170203519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10efa412c2174b31bf584dc011340328", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aae5c21-3c", "ovs_interfaceid": "7aae5c21-3ca3-43da-b71b-643dd8e5e0b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:55:a8,bridge_name='br-int',has_traffic_filtering=True,id=7aae5c21-3ca3-43da-b71b-643dd8e5e0b4,network=Network(16b3fb2e-3da2-401b-a4ea-924cf059c727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aae5c21-3c') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG os_vif [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:55:a8,bridge_name='br-int',has_traffic_filtering=True,id=7aae5c21-3ca3-43da-b71b-643dd8e5e0b4,network=Network(16b3fb2e-3da2-401b-a4ea-924cf059c727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aae5c21-3c') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7aae5c21-3c, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:00 user nova-compute[71347]: INFO os_vif [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:55:a8,bridge_name='br-int',has_traffic_filtering=True,id=7aae5c21-3ca3-43da-b71b-643dd8e5e0b4,network=Network(16b3fb2e-3da2-401b-a4ea-924cf059c727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aae5c21-3c')
Apr 14 14:45:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Deleting instance files /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c_del
Apr 14 14:45:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Deletion of /opt/stack/data/nova/instances/47e05edc-4808-49de-b882-addd28b2258c_del complete
Apr 14 14:45:00 user nova-compute[71347]: INFO nova.compute.manager [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 14:45:00 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:45:00 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 47e05edc-4808-49de-b882-addd28b2258c] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:45:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] No waiting events found dispatching network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:45:02 user nova-compute[71347]: WARNING nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received unexpected event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance with vm_state active and task_state deleting.
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] No waiting events found dispatching network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:45:02 user nova-compute[71347]: WARNING nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received unexpected event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance with vm_state active and task_state deleting.
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] No waiting events found dispatching network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:45:02 user nova-compute[71347]: WARNING nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received unexpected event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance with vm_state active and task_state deleting.
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-unplugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] No waiting events found dispatching network-vif-unplugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.manager [req-41b66e40-4dda-4f7f-a1d1-de5550d8cdbc req-b1c7d0e8-d504-4eaa-9884-6acf8f05b6ec service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-unplugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:45:02 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Took 1.68 seconds to deallocate network for instance.
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:02 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Deleted allocations for instance 47e05edc-4808-49de-b882-addd28b2258c
Apr 14 14:45:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-3ffaae60-6d31-4a25-8ed3-b9920122d3c5 tempest-SnapshotDataIntegrityTests-1043128591 tempest-SnapshotDataIntegrityTests-1043128591-project-member] Lock "47e05edc-4808-49de-b882-addd28b2258c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.956s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Acquiring lock "47e05edc-4808-49de-b882-addd28b2258c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] Lock "47e05edc-4808-49de-b882-addd28b2258c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] No waiting events found dispatching network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:45:04 user nova-compute[71347]: WARNING nova.compute.manager [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received unexpected event network-vif-plugged-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 for instance with vm_state deleted and task_state None.
Apr 14 14:45:04 user nova-compute[71347]: DEBUG nova.compute.manager [req-367e0250-d03e-457d-96b5-a8aff9562a39 req-f3d351e7-530f-4279-a0c3-715e2e1fdf4a service nova] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Received event network-vif-deleted-7aae5c21-3ca3-43da-b71b-643dd8e5e0b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:45:10 user nova-compute[71347]: INFO nova.compute.claims [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Claim successful on node user
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:45:10 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG nova.policy [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:45:10 user nova-compute[71347]: INFO nova.virt.block_device [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Booting with blank volume at /dev/vda
Apr 14 14:45:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:45:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Successfully created port: f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Successfully updated port: f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquired lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-changed-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Refreshing instance network info cache due to event network-changed-f9319e65-c182-46c2-8bed-b519138df9fc. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] Acquiring lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:45:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:45:12 user nova-compute[71347]: DEBUG nova.network.neutron [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:45:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Releasing lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:45:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance network_info: |[{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:45:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] Acquired lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:45:12 user nova-compute[71347]: DEBUG nova.network.neutron [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Refreshing network info cache for port f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:45:12 user nova-compute[71347]: DEBUG nova.network.neutron [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updated VIF entry in instance network info cache for port f9319e65-c182-46c2-8bed-b519138df9fc. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:45:12 user nova-compute[71347]: DEBUG nova.network.neutron [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:45:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-1bb75df2-c01f-4652-9602-8d5b8ef6ee72 req-311204ee-9763-4134-abf4-defe825c1835 service nova] Releasing lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:45:13 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:15 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483500.8210714, 47e05edc-4808-49de-b882-addd28b2258c => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:45:15 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 47e05edc-4808-49de-b882-addd28b2258c] VM Stopped (Lifecycle Event)
Apr 14 14:45:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-9fc838d2-a959-428b-8671-abde1fd9484f None None] [instance: 47e05edc-4808-49de-b882-addd28b2258c] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:45:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:45:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:45:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:45:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG os_brick.utils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[932dbbcc-79fb-41f5-9b11-c1e1c3d943ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4492ce-94f7-4c05-9499-82d093a198df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9155f2c-6c0f-419d-8f67-5f7beac8c5a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d104fe-3aaa-498a-8740-f28ea139fdf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:45:16 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:45:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8999a4-d07b-4719-af3a-c56d7ef422ed]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG os_brick.utils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:45:16 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating existing volume attachment record: 265b3808-9fe6-45cb-a96d-7bbda8454049 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:45:18 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:18 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:45:19 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:45:19 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=26.399463653564453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 26d4aa8c-3e3b-4988-9876-1538edd88744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:45:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:45:21 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Creating image(s)
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Ensure instance console log exists: /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Start _get_guest_xml network_info=[{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XabYsycZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43bcfbdd-5fc4-4c83-8d67-f660404766b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'serial': 'f0fce133-81e8-4f8e-b0d7-2e1772dc03bc'}, 'attachment_id': '265b3808-9fe6-45cb-a96d-7bbda8454049', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:45:21 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:45:21 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XabYsycZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:45:21 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:45:21 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:45:21 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7a9910-9aed-41db-aac6-16a147610099]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:45:21 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe572183-f356-4f35-bba9-20a92056d3d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc] added
Apr 14 14:45:21 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29c3bc3-5343-486d-9e28-2d65fa84edb9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d72293-b14c-41df-b224-1505e52a9901]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XabYsycZ {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XabYsycZ" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63d6e87-fccb-4cc1-9942-2ca4b46861bb]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XabYsycZ'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[525642cf-fc4b-47ab-baa9-0b587a9ee62c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfcacde-396e-4c60-aed6-9c187d281826]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)
Apr 14 14:45:21 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)
Apr 14 14:45:21 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e884bc3-b426-4afe-929a-9146f6387a95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc, portal: 172.16.0.220,3260]
Apr 14 14:45:21 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc, portal: 172.16.0.220,3260] successful.
Apr 14 14:45:21 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a852f24a-f061-408d-a92d-074624d72ea7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d5056-20ac-41eb-bf3a-edeca2788e84]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)
Apr 14 14:45:21 user nova-compute[71347]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:45:21 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)
Apr 14 14:45:21 user nova-compute[71347]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:45:21 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[27323845-8531-4c8c-bab8-3c9503c87838]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:45:21 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XabYsycZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26365343164363663', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365343164363663', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437168363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437168363',id=40,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-iqodiw6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:45:11Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=43bcfbdd-5fc4-4c83-8d67-f660404766b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:54,bridge_name='br-int',has_traffic_filtering=True,id=f9319e65-c182-46c2-8bed-b519138df9fc,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9319e65-c1') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.objects.instance [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'pci_devices' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:45:22 user nova-compute[71347]:   <uuid>43bcfbdd-5fc4-4c83-8d67-f660404766b2</uuid>
Apr 14 14:45:22 user nova-compute[71347]:   <name>instance-00000028</name>
Apr 14 14:45:22 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:45:22 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:45:22 user nova-compute[71347]:   <metadata>
Apr 14 14:45:22 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:45:22 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:45:22 user nova-compute[71347]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-437168363</nova:name>
Apr 14 14:45:22 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:45:21</nova:creationTime>
Apr 14 14:45:22 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:45:22 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:45:22 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:45:22 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:45:22 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:45:22 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:45:22 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:45:22 user nova-compute[71347]:       <nova:owner>
Apr 14 14:45:22 user nova-compute[71347]:         <nova:user uuid="2e321f85d3d44c2baf210a1962f4f08f">tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member</nova:user>
Apr 14 14:45:22 user nova-compute[71347]:         <nova:project uuid="2241300ad3704734aed3990cc7aadc1b">tempest-ServerBootFromVolumeStableRescueTest-2086147649</nova:project>
Apr 14 14:45:22 user nova-compute[71347]:       </nova:owner>
Apr 14 14:45:22 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:45:22 user nova-compute[71347]:       <nova:ports>
Apr 14 14:45:22 user nova-compute[71347]:         <nova:port uuid="f9319e65-c182-46c2-8bed-b519138df9fc">
Apr 14 14:45:22 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 14:45:22 user nova-compute[71347]:         </nova:port>
Apr 14 14:45:22 user nova-compute[71347]:       </nova:ports>
Apr 14 14:45:22 user nova-compute[71347]:     </nova:instance>
Apr 14 14:45:22 user nova-compute[71347]:   </metadata>
Apr 14 14:45:22 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:45:22 user nova-compute[71347]:     <system>
Apr 14 14:45:22 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:45:22 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:45:22 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:45:22 user nova-compute[71347]:       <entry name="serial">43bcfbdd-5fc4-4c83-8d67-f660404766b2</entry>
Apr 14 14:45:22 user nova-compute[71347]:       <entry name="uuid">43bcfbdd-5fc4-4c83-8d67-f660404766b2</entry>
Apr 14 14:45:22 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:45:22 user nova-compute[71347]:     </system>
Apr 14 14:45:22 user nova-compute[71347]:   </sysinfo>
Apr 14 14:45:22 user nova-compute[71347]:   <os>
Apr 14 14:45:22 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:45:22 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:45:22 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:45:22 user nova-compute[71347]:   </os>
Apr 14 14:45:22 user nova-compute[71347]:   <features>
Apr 14 14:45:22 user nova-compute[71347]:     <acpi/>
Apr 14 14:45:22 user nova-compute[71347]:     <apic/>
Apr 14 14:45:22 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:45:22 user nova-compute[71347]:   </features>
Apr 14 14:45:22 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:45:22 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:45:22 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:45:22 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:45:22 user nova-compute[71347]:   </clock>
Apr 14 14:45:22 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:45:22 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:45:22 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:45:22 user nova-compute[71347]:   </cpu>
Apr 14 14:45:22 user nova-compute[71347]:   <devices>
Apr 14 14:45:22 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:45:22 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:45:22 user nova-compute[71347]:       <source dev="/dev/sdc"/>
Apr 14 14:45:22 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:45:22 user nova-compute[71347]:       <serial>f0fce133-81e8-4f8e-b0d7-2e1772dc03bc</serial>
Apr 14 14:45:22 user nova-compute[71347]:     </disk>
Apr 14 14:45:22 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:45:22 user nova-compute[71347]:       <mac address="fa:16:3e:ee:e7:54"/>
Apr 14 14:45:22 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:45:22 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:45:22 user nova-compute[71347]:       <target dev="tapf9319e65-c1"/>
Apr 14 14:45:22 user nova-compute[71347]:     </interface>
Apr 14 14:45:22 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:45:22 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/console.log" append="off"/>
Apr 14 14:45:22 user nova-compute[71347]:     </serial>
Apr 14 14:45:22 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:45:22 user nova-compute[71347]:     <video>
Apr 14 14:45:22 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:45:22 user nova-compute[71347]:     </video>
Apr 14 14:45:22 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:45:22 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:45:22 user nova-compute[71347]:     </rng>
Apr 14 14:45:22 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:45:22 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:45:22 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:45:22 user nova-compute[71347]:     </memballoon>
Apr 14 14:45:22 user nova-compute[71347]:   </devices>
Apr 14 14:45:22 user nova-compute[71347]: </domain>
Apr 14 14:45:22 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437168363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437168363',id=40,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-iqodiw6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:45:11Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=43bcfbdd-5fc4-4c83-8d67-f660404766b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:54,bridge_name='br-int',has_traffic_filtering=True,id=f9319e65-c182-46c2-8bed-b519138df9fc,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9319e65-c1') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG os_vif [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:54,bridge_name='br-int',has_traffic_filtering=True,id=f9319e65-c182-46c2-8bed-b519138df9fc,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9319e65-c1') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9319e65-c1, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9319e65-c1, col_values=(('external_ids', {'iface-id': 'f9319e65-c182-46c2-8bed-b519138df9fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:e7:54', 'vm-uuid': '43bcfbdd-5fc4-4c83-8d67-f660404766b2'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:22 user nova-compute[71347]: INFO os_vif [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:54,bridge_name='br-int',has_traffic_filtering=True,id=f9319e65-c182-46c2-8bed-b519138df9fc,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9319e65-c1')
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No VIF found with MAC fa:16:3e:ee:e7:54, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:45:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Skipping network cache update for instance because it is Building. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:45:24 user nova-compute[71347]: WARNING nova.compute.manager [req-d4094b54-270c-4b81-bb99-4ca7a38ab261 req-b7711e35-d7dc-4431-8a55-01ea194fb7c7 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state building and task_state spawning.
Apr 14 14:45:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:25 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483526.0134377, 43bcfbdd-5fc4-4c83-8d67-f660404766b2 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:45:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] VM Resumed (Lifecycle Event)
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:45:26 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance spawned successfully.
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:45:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483526.0161817, 43bcfbdd-5fc4-4c83-8d67-f660404766b2 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:45:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] VM Started (Lifecycle Event)
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:45:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:45:26 user nova-compute[71347]: INFO nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Took 4.84 seconds to spawn the instance on the hypervisor.
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:45:26 user nova-compute[71347]: WARNING nova.compute.manager [req-5e1a01e0-b1d6-4f94-bcd4-dfea7d031c99 req-8e36fd3c-ad54-463a-a8e3-4dd478116147 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state None.
Apr 14 14:45:26 user nova-compute[71347]: INFO nova.compute.manager [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Took 16.09 seconds to build instance.
Apr 14 14:45:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-dc42b35d-02df-4754-acf6-9c93d7d2e167 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.215s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:45:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:45:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:45:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:45:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:45:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:45:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:45:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:45:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:45:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:45:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "26d4aa8c-3e3b-4988-9876-1538edd88744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:46:10 user nova-compute[71347]: INFO nova.compute.manager [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Terminating instance
Apr 14 14:46:10 user nova-compute[71347]: DEBUG nova.compute.manager [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:10 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received event network-vif-unplugged-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] Acquiring lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] No waiting events found dispatching network-vif-unplugged-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.compute.manager [req-88e10967-22bc-433e-8560-55aee94bdfe2 req-3e00720c-73f5-4614-a9db-9c8e7b930355 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received event network-vif-unplugged-27658df0-382a-404b-afde-a2f3f50eeeb2 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:46:11 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Instance destroyed successfully.
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.objects.instance [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'resources' on Instance uuid 26d4aa8c-3e3b-4988-9876-1538edd88744 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1057433537',display_name='tempest-TestVolumeBootPattern-server-1057433537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1057433537',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-mscn65ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:44:36Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=26d4aa8c-3e3b-4988-9876-1538edd88744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "27658df0-382a-404b-afde-a2f3f50eeeb2", "address": "fa:16:3e:05:c5:b0", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27658df0-38", "ovs_interfaceid": "27658df0-382a-404b-afde-a2f3f50eeeb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b0,bridge_name='br-int',has_traffic_filtering=True,id=27658df0-382a-404b-afde-a2f3f50eeeb2,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27658df0-38') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_vif [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b0,bridge_name='br-int',has_traffic_filtering=True,id=27658df0-382a-404b-afde-a2f3f50eeeb2,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27658df0-38') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27658df0-38, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:46:11 user nova-compute[71347]: INFO os_vif [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b0,bridge_name='br-int',has_traffic_filtering=True,id=27658df0-382a-404b-afde-a2f3f50eeeb2,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27658df0-38')
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuYdVXNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:46:11 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74fb90c-2e98-432c-b927-c6c2b0982cd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:46:11 user nova-compute[71347]: No targets found.
Apr 14 14:46:11 user nova-compute[71347]: iSNS:
Apr 14 14:46:11 user nova-compute[71347]: No targets found.
Apr 14 14:46:11 user nova-compute[71347]: STATIC:
Apr 14 14:46:11 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45
Apr 14 14:46:11 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:46:11 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:46:11 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 14:46:11 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:46:11 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:46:11 user nova-compute[71347]: FIRMWARE:
Apr 14 14:46:11 user nova-compute[71347]: No targets found.
Apr 14 14:46:11 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:46:11 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:46:11 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6920038-360e-4e97-be82-8d1cb413203f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0311097e-280d-4b4c-94b6-f79c9c0acd18]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)
Apr 14 14:46:11 user nova-compute[71347]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:46:11 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 (non-flash)
Apr 14 14:46:11 user nova-compute[71347]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:46:11 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4b73490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[349110b7-cd46-4551-a21d-05aa658ff2e7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fde272-e5a0-446e-b247-49b8ea48ac2a]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f23ea5a-dfe6-40d9-8e0d-38b9c5185413]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d298815f-d664-42b0-93fc-3234d1d37fab]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7176e6cf', '/dev/disk/by-id/scsi-23233613833653236', '/dev/disk/by-id/scsi-1SCST_BIO7176e6cf-23a83e26dbc9d47a') {{(pid=82022) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3403a84d-38d7-481c-aaf1-622fdd0fabba]: (4, None) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[87642a25-c148-4b95-a4f5-7511d98560fd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e20105b-09a7-49d2-81ab-8cb4071fbb76]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45, portal: 172.16.0.220,3260]
Apr 14 14:46:11 user nova-compute[71347]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45, portal: 172.16.0.220,3260] successful.
Apr 14 14:46:11 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561ea471-b5ab-4748-8953-c5d40f67af45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[353c819d-c381-4e40-a9d6-1ac8d83d75f7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== disconnect_volume: return (322ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:46:11 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Deleting instance files /opt/stack/data/nova/instances/26d4aa8c-3e3b-4988-9876-1538edd88744_del
Apr 14 14:46:11 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Deletion of /opt/stack/data/nova/instances/26d4aa8c-3e3b-4988-9876-1538edd88744_del complete
Apr 14 14:46:11 user nova-compute[71347]: INFO nova.compute.manager [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 14 14:46:11 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:46:11 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:46:12 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:46:12 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Took 0.79 seconds to deallocate network for instance.
Apr 14 14:46:12 user nova-compute[71347]: DEBUG nova.compute.manager [req-a5ab5792-cdda-45f1-a6e7-bcfc75d58f82 req-c36827a9-65d6-48c4-9a75-ac1109dbfb60 service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received event network-vif-deleted-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received event network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] Acquiring lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG nova.compute.manager [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] No waiting events found dispatching network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:46:13 user nova-compute[71347]: WARNING nova.compute.manager [req-7c2af277-eb0f-4c61-9c5a-205fb48c0eab req-9cb63f30-df99-4593-8329-bba6a8e5ef7a service nova] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Received unexpected event network-vif-plugged-27658df0-382a-404b-afde-a2f3f50eeeb2 for instance with vm_state active and task_state deleting.
Apr 14 14:46:13 user nova-compute[71347]: INFO nova.compute.manager [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Took 0.88 seconds to detach 1 volumes for instance.
Apr 14 14:46:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Deleting volume: 561ea471-b5ab-4748-8953-c5d40f67af45 {{(pid=71347) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:46:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:46:13 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Deleted allocations for instance 26d4aa8c-3e3b-4988-9876-1538edd88744
Apr 14 14:46:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-233b7e01-188b-47bd-82f7-7b8ba1b2b306 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "26d4aa8c-3e3b-4988-9876-1538edd88744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.011s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:46:15 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:46:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:46:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:46:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:46:20 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:46:20 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=26.38162612915039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:46:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:46:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:46:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:46:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:46:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:46:24 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:25 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:26 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483571.192144, 26d4aa8c-3e3b-4988-9876-1538edd88744 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:46:26 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] VM Stopped (Lifecycle Event)
Apr 14 14:46:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-800a38be-f5d5-49d3-8987-c999c869471a None None] [instance: 26d4aa8c-3e3b-4988-9876-1538edd88744] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:46:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:46:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:31 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:36 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:46:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:46:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:46:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:47:00 user nova-compute[71347]: INFO nova.compute.manager [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Rescuing
Apr 14 14:47:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:47:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquired lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:47:00 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Releasing lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:01 user nova-compute[71347]: WARNING nova.compute.manager [req-c0c41a9c-4848-455a-b626-f7d2925ce8c2 req-f625fdfe-22aa-4b9d-8d60-e72efcd5719b service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state rescuing.
Apr 14 14:47:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:01 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance destroyed successfully.
Apr 14 14:47:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Attempting a stable device rescue
Apr 14 14:47:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71347) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance directory exists: not creating {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 14:47:02 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Creating image(s)
Apr 14 14:47:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "/opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "/opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "/opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "f8520de6afc2d295576c15f7deb8e2496baa2a4c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:02 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "f8520de6afc2d295576c15f7deb8e2496baa2a4c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c.part --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.virt.images [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 483113b9-0f50-4da7-a9eb-d95c302c95e5 was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c.part /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:03 user nova-compute[71347]: WARNING nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state rescuing.
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:03 user nova-compute[71347]: WARNING nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state rescuing.
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:03 user nova-compute[71347]: WARNING nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state rescuing.
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:03 user nova-compute[71347]: WARNING nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state rescuing.
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:03 user nova-compute[71347]: WARNING nova.compute.manager [req-6d1c8d7b-5442-49d8-9c43-ac9c5004d98c req-f4a798e8-75a1-4219-8b0c-0e857aebdb8e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state rescuing.
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c.part /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c.converted" returned: 0 in 0.614s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:03 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "f8520de6afc2d295576c15f7deb8e2496baa2a4c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.682s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "f8520de6afc2d295576c15f7deb8e2496baa2a4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "f8520de6afc2d295576c15f7deb8e2496baa2a4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c,backing_fmt=raw /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c,backing_fmt=raw /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue" returned: 0 in 0.059s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "f8520de6afc2d295576c15f7deb8e2496baa2a4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'migration_context' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Start _get_guest_xml network_info=[{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "vif_mac": "fa:16:3e:ee:e7:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '483113b9-0f50-4da7-a9eb-d95c302c95e5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XabYsycZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '43bcfbdd-5fc4-4c83-8d67-f660404766b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'serial': 'f0fce133-81e8-4f8e-b0d7-2e1772dc03bc'}, 'attachment_id': '265b3808-9fe6-45cb-a96d-7bbda8454049', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'resources' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'numa_topology' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:47:04 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:47:04 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XabYsycZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:47:04 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:47:04 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:47:04 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[efda3946-fe3a-4621-ab8a-52735df13b6a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XabYsycZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 14:47:04 user nova-compute[71347]: node.name = iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 14:47:04 user nova-compute[71347]: node.tpgt = -1
Apr 14 14:47:04 user nova-compute[71347]: node.startup = automatic
Apr 14 14:47:04 user nova-compute[71347]: node.leading_login = No
Apr 14 14:47:04 user nova-compute[71347]: iface.iscsi_ifacename = default
Apr 14 14:47:04 user nova-compute[71347]: iface.net_ifacename = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.ipaddress = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.prefix_len = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.hwaddress = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.transport_name = tcp
Apr 14 14:47:04 user nova-compute[71347]: iface.initiatorname = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.state = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.vlan_id = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.vlan_priority = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.vlan_state = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.iface_num = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.mtu = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.port = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.bootproto = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.subnet_mask = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.gateway = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.dhcp_alt_client_id = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.dhcp_dns = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.dhcp_learn_iqn = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.dhcp_vendor_id_state = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.dhcp_vendor_id = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.dhcp_slp_da = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.fragmentation = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.gratuitous_arp = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.incoming_forwarding = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.tos_state = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.tos = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.ttl = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.delayed_ack = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.tcp_nagle = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.tcp_wsf_state = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.tcp_wsf = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.tcp_timer_scale = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.tcp_timestamp = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.redirect = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.def_task_mgmt_timeout = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.header_digest = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.data_digest = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.immediate_data = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.initial_r2t = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.data_seq_inorder = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.data_pdu_inorder = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.erl = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.max_receive_data_len = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.first_burst_len = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.max_outstanding_r2t = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.max_burst_len = 0
Apr 14 14:47:04 user nova-compute[71347]: iface.chap_auth = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.bidi_chap = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.strict_login_compliance = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.discovery_auth = <empty>
Apr 14 14:47:04 user nova-compute[71347]: iface.discovery_logout = <empty>
Apr 14 14:47:04 user nova-compute[71347]: node.discovery_address = <empty>
Apr 14 14:47:04 user nova-compute[71347]: node.discovery_port = 0
Apr 14 14:47:04 user nova-compute[71347]: node.discovery_type = static
Apr 14 14:47:04 user nova-compute[71347]: node.session.initial_cmdsn = 0
Apr 14 14:47:04 user nova-compute[71347]: node.session.initial_login_retry_max = 8
Apr 14 14:47:04 user nova-compute[71347]: node.session.xmit_thread_priority = -20
Apr 14 14:47:04 user nova-compute[71347]: node.session.cmds_max = 128
Apr 14 14:47:04 user nova-compute[71347]: node.session.queue_depth = 32
Apr 14 14:47:04 user nova-compute[71347]: node.session.nr_sessions = 1
Apr 14 14:47:04 user nova-compute[71347]: node.session.auth.authmethod = CHAP
Apr 14 14:47:04 user nova-compute[71347]: node.session.auth.username = XabYsycZ
Apr 14 14:47:04 user nova-compute[71347]: node.session.auth.password = ***
Apr 14 14:47:04 user nova-compute[71347]: node.session.auth.username_in = <empty>
Apr 14 14:47:04 user nova-compute[71347]: node.session.auth.password_in = <empty>
Apr 14 14:47:04 user nova-compute[71347]: node.session.auth.chap_algs = MD5
Apr 14 14:47:04 user nova-compute[71347]: node.session.timeo.replacement_timeout = 120
Apr 14 14:47:04 user nova-compute[71347]: node.session.err_timeo.abort_timeout = 15
Apr 14 14:47:04 user nova-compute[71347]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 14:47:04 user nova-compute[71347]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 14:47:04 user nova-compute[71347]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.FastAbort = Yes
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.InitialR2T = No
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.ImmediateData = Yes
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.MaxConnections = 1
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 14:47:04 user nova-compute[71347]: node.session.iscsi.ERL = 0
Apr 14 14:47:04 user nova-compute[71347]: node.session.scan = manual
Apr 14 14:47:04 user nova-compute[71347]: node.session.reopen_max = 0
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].address = 172.16.0.220
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].port = 3260
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].startup = manual
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].tcp.window_size = 524288
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].tcp.type_of_service = 0
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].timeo.logout_timeout = 15
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].timeo.login_timeout = 15
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].timeo.auth_timeout = 45
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].iscsi.DataDigest = None
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].iscsi.IFMarker = No
Apr 14 14:47:04 user nova-compute[71347]: node.conn[0].iscsi.OFMarker = No
Apr 14 14:47:04 user nova-compute[71347]: # END RECORD
Apr 14 14:47:04 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3cc3b5-2798-4bcf-a378-3dd8228a32b9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bba4721-91a0-4447-a8a1-a9ab6a813ea4]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XabYsycZ {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XabYsycZ" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22364ef-f092-4acc-aca5-9efda101d063]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XabYsycZ'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d821845-6e5a-4b6a-8900-cc689ad30f53]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc25781-9b3c-4124-a46c-7c2a02e0a181]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:47:04 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:47:04 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] HCTL ('34', '0', '0', 0) found on session 48 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e324848c-7ded-40ff-9157-8345f1835453]: (4, ('0 0 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Searching for a device in session 48 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XabYsycZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.173s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '26365343164363663', 'path': '/dev/sdc'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365343164363663', 'path': '/dev/sdc'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437168363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437168363',id=40,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-iqodiw6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:45:26Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=43bcfbdd-5fc4-4c83-8d67-f660404766b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "vif_mac": "fa:16:3e:ee:e7:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "vif_mac": "fa:16:3e:ee:e7:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:e7:54,bridge_name='br-int',has_traffic_filtering=True,id=f9319e65-c182-46c2-8bed-b519138df9fc,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9319e65-c1') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'pci_devices' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:47:04 user nova-compute[71347]:   <uuid>43bcfbdd-5fc4-4c83-8d67-f660404766b2</uuid>
Apr 14 14:47:04 user nova-compute[71347]:   <name>instance-00000028</name>
Apr 14 14:47:04 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:47:04 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:47:04 user nova-compute[71347]:   <metadata>
Apr 14 14:47:04 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:47:04 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:47:04 user nova-compute[71347]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-437168363</nova:name>
Apr 14 14:47:04 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:47:04</nova:creationTime>
Apr 14 14:47:04 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:47:04 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:47:04 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:47:04 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:47:04 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:47:04 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:47:04 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:47:04 user nova-compute[71347]:       <nova:owner>
Apr 14 14:47:04 user nova-compute[71347]:         <nova:user uuid="2e321f85d3d44c2baf210a1962f4f08f">tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member</nova:user>
Apr 14 14:47:04 user nova-compute[71347]:         <nova:project uuid="2241300ad3704734aed3990cc7aadc1b">tempest-ServerBootFromVolumeStableRescueTest-2086147649</nova:project>
Apr 14 14:47:04 user nova-compute[71347]:       </nova:owner>
Apr 14 14:47:04 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:47:04 user nova-compute[71347]:       <nova:ports>
Apr 14 14:47:04 user nova-compute[71347]:         <nova:port uuid="f9319e65-c182-46c2-8bed-b519138df9fc">
Apr 14 14:47:04 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 14:47:04 user nova-compute[71347]:         </nova:port>
Apr 14 14:47:04 user nova-compute[71347]:       </nova:ports>
Apr 14 14:47:04 user nova-compute[71347]:     </nova:instance>
Apr 14 14:47:04 user nova-compute[71347]:   </metadata>
Apr 14 14:47:04 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:47:04 user nova-compute[71347]:     <system>
Apr 14 14:47:04 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:47:04 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:47:04 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:47:04 user nova-compute[71347]:       <entry name="serial">43bcfbdd-5fc4-4c83-8d67-f660404766b2</entry>
Apr 14 14:47:04 user nova-compute[71347]:       <entry name="uuid">43bcfbdd-5fc4-4c83-8d67-f660404766b2</entry>
Apr 14 14:47:04 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:47:04 user nova-compute[71347]:     </system>
Apr 14 14:47:04 user nova-compute[71347]:   </sysinfo>
Apr 14 14:47:04 user nova-compute[71347]:   <os>
Apr 14 14:47:04 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:47:04 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:47:04 user nova-compute[71347]:   </os>
Apr 14 14:47:04 user nova-compute[71347]:   <features>
Apr 14 14:47:04 user nova-compute[71347]:     <acpi/>
Apr 14 14:47:04 user nova-compute[71347]:     <apic/>
Apr 14 14:47:04 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:47:04 user nova-compute[71347]:   </features>
Apr 14 14:47:04 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:47:04 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:47:04 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:47:04 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:47:04 user nova-compute[71347]:   </clock>
Apr 14 14:47:04 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:47:04 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:47:04 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:47:04 user nova-compute[71347]:   </cpu>
Apr 14 14:47:04 user nova-compute[71347]:   <devices>
Apr 14 14:47:04 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:47:04 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:47:04 user nova-compute[71347]:       <source dev="/dev/sdc"/>
Apr 14 14:47:04 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:47:04 user nova-compute[71347]:       <serial>f0fce133-81e8-4f8e-b0d7-2e1772dc03bc</serial>
Apr 14 14:47:04 user nova-compute[71347]:     </disk>
Apr 14 14:47:04 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:47:04 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:47:04 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue"/>
Apr 14 14:47:04 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:47:04 user nova-compute[71347]:       <boot order="1"/>
Apr 14 14:47:04 user nova-compute[71347]:     </disk>
Apr 14 14:47:04 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:47:04 user nova-compute[71347]:       <mac address="fa:16:3e:ee:e7:54"/>
Apr 14 14:47:04 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:47:04 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:47:04 user nova-compute[71347]:       <target dev="tapf9319e65-c1"/>
Apr 14 14:47:04 user nova-compute[71347]:     </interface>
Apr 14 14:47:04 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:47:04 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/console.log" append="off"/>
Apr 14 14:47:04 user nova-compute[71347]:     </serial>
Apr 14 14:47:04 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:47:04 user nova-compute[71347]:     <video>
Apr 14 14:47:04 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:47:04 user nova-compute[71347]:     </video>
Apr 14 14:47:04 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:47:04 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:47:04 user nova-compute[71347]:     </rng>
Apr 14 14:47:04 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:47:04 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:47:04 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:47:04 user nova-compute[71347]:     </memballoon>
Apr 14 14:47:04 user nova-compute[71347]:   </devices>
Apr 14 14:47:04 user nova-compute[71347]: </domain>
Apr 14 14:47:04 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:47:04 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance destroyed successfully.
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:47:04 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No VIF found with MAC fa:16:3e:ee:e7:54, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:47:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:06 user nova-compute[71347]: WARNING nova.compute.manager [req-9ba37b31-68eb-4cea-b94d-8620a535c1cc req-d4035e1b-00e7-4b0c-a1e2-c4ee3fc93a0e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state rescuing.
Apr 14 14:47:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 43bcfbdd-5fc4-4c83-8d67-f660404766b2 due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483628.1503363, 43bcfbdd-5fc4-4c83-8d67-f660404766b2 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:47:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] VM Resumed (Lifecycle Event)
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f88ea7c8-8f69-4283-99e0-4686ce390d3f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:47:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483628.1571429, 43bcfbdd-5fc4-4c83-8d67-f660404766b2 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:47:08 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] VM Started (Lifecycle Event)
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:08 user nova-compute[71347]: WARNING nova.compute.manager [req-4285a072-aeec-462d-9712-7552fac3b620 req-1b111932-551d-4f4a-84a6-45c1f0ae3fa7 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state rescued and task_state None.
Apr 14 14:47:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "a3225314-c927-4d5d-871a-d80442c5f8a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:47:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:12 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:12 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:47:12 user nova-compute[71347]: INFO nova.compute.claims [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Claim successful on node user
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:47:13 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:47:13 user nova-compute[71347]: INFO nova.virt.block_device [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Booting with volume f69a7e0c-25ef-40b8-949d-a3d18bcc846c at /dev/vda
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.policy [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG os_brick.utils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79f05b7-cc28-4a66-9a09-becb5b07f934]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aad53cc-ff83-4a4b-ac2d-64064d7ab15a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fe470f-3a39-4d16-8ed6-79e5d4c96d84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[20055d83-2752-4880-a083-1d24c3599e74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:47:13 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:47:13 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1b4e75-dccd-4f7d-ba94-6c582b9ea8d3]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG os_brick.utils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Updating existing volume attachment record: f2880212-ae6a-40b7-89ff-e5d738fa5913 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:47:13 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Successfully created port: a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:47:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Successfully updated port: a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:47:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:47:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquired lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:47:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:47:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received event network-changed-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:14 user nova-compute[71347]: DEBUG nova.compute.manager [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Refreshing instance network info cache due to event network-changed-a3103941-cf0f-49a8-a2a9-28decc5e0c04. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:47:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] Acquiring lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:47:14 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:47:15 user nova-compute[71347]: DEBUG nova.network.neutron [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Updating instance_info_cache with network_info: [{"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:47:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Releasing lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:47:15 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Instance network_info: |[{"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:47:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] Acquired lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:47:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Refreshing network info cache for port a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:47:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Updated VIF entry in instance network info cache for port a3103941-cf0f-49a8-a2a9-28decc5e0c04. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:47:15 user nova-compute[71347]: DEBUG nova.network.neutron [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Updating instance_info_cache with network_info: [{"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:47:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-45007f50-e4f6-4756-b3b4-f36176cd3d99 req-7c394b89-965a-4348-bf36-5ac16fceff68 service nova] Releasing lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:47:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:16 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:47:18 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Creating image(s)
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Ensure instance console log exists: /opt/stack/data/nova/instances/a3225314-c927-4d5d-871a-d80442c5f8a1/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Start _get_guest_xml network_info=[{"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJTyrmlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3225314-c927-4d5d-871a-d80442c5f8a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f69a7e0c-25ef-40b8-949d-a3d18bcc846c', 'serial': 'f69a7e0c-25ef-40b8-949d-a3d18bcc846c'}, 'attachment_id': 'f2880212-ae6a-40b7-89ff-e5d738fa5913', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:47:18 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:47:18 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJTyrmlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:47:18 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:47:18 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:47:18 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88d1800-6a5b-4bab-8a7f-6a79c4646c98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:47:18 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[827434b4-ae2e-4c26-ace6-3df63e25ab6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c] added
Apr 14 14:47:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa60db2-2ac7-4155-bcae-f4cb9ea67871]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[61442d25-431d-4fa1-956b-541dd8f7985c]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJTyrmlB {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJTyrmlB" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19536b6-d141-48ef-b7d3-2c46b4103de0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eJTyrmlB'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ece9a09-2aa6-4447-9d23-153b33cd0663]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2006d8c-8eb2-4336-aff4-777a4eea42cf]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:47:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:47:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a3c6e8-e539-4aff-b383-6e80dacf87ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c, portal: 172.16.0.220,3260]
Apr 14 14:47:18 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c, portal: 172.16.0.220,3260] successful.
Apr 14 14:47:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[03820fda-0909-45c1-ad56-8103ac507ce9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7885882d-e0be-42f5-9754-cf320637bd1c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:47:18 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:47:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:47:18 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:47:18 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d326f-85b7-4f4e-a9a9-9d3934fd73b5]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:47:18 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJTyrmlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26635646662653130', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635646662653130', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-510292440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-510292440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-510292440',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-r2sgevqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:47:13Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=a3225314-c927-4d5d-871a-d80442c5f8a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=a3103941-cf0f-49a8-a2a9-28decc5e0c04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3103941-cf') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.objects.instance [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'pci_devices' on Instance uuid a3225314-c927-4d5d-871a-d80442c5f8a1 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:47:19 user nova-compute[71347]:   <uuid>a3225314-c927-4d5d-871a-d80442c5f8a1</uuid>
Apr 14 14:47:19 user nova-compute[71347]:   <name>instance-00000029</name>
Apr 14 14:47:19 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:47:19 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:47:19 user nova-compute[71347]:   <metadata>
Apr 14 14:47:19 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:47:19 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:47:19 user nova-compute[71347]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-510292440</nova:name>
Apr 14 14:47:19 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:47:18</nova:creationTime>
Apr 14 14:47:19 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:47:19 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:47:19 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:47:19 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:47:19 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:47:19 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:47:19 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:47:19 user nova-compute[71347]:       <nova:owner>
Apr 14 14:47:19 user nova-compute[71347]:         <nova:user uuid="43b5d8526a7c4b0fb5f15a8345b229e2">tempest-TestVolumeBootPattern-152189831-project-member</nova:user>
Apr 14 14:47:19 user nova-compute[71347]:         <nova:project uuid="e217ba6818e94879aa02015ccf21b058">tempest-TestVolumeBootPattern-152189831</nova:project>
Apr 14 14:47:19 user nova-compute[71347]:       </nova:owner>
Apr 14 14:47:19 user nova-compute[71347]:       <nova:ports>
Apr 14 14:47:19 user nova-compute[71347]:         <nova:port uuid="a3103941-cf0f-49a8-a2a9-28decc5e0c04">
Apr 14 14:47:19 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 14:47:19 user nova-compute[71347]:         </nova:port>
Apr 14 14:47:19 user nova-compute[71347]:       </nova:ports>
Apr 14 14:47:19 user nova-compute[71347]:     </nova:instance>
Apr 14 14:47:19 user nova-compute[71347]:   </metadata>
Apr 14 14:47:19 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:47:19 user nova-compute[71347]:     <system>
Apr 14 14:47:19 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:47:19 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:47:19 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:47:19 user nova-compute[71347]:       <entry name="serial">a3225314-c927-4d5d-871a-d80442c5f8a1</entry>
Apr 14 14:47:19 user nova-compute[71347]:       <entry name="uuid">a3225314-c927-4d5d-871a-d80442c5f8a1</entry>
Apr 14 14:47:19 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:47:19 user nova-compute[71347]:     </system>
Apr 14 14:47:19 user nova-compute[71347]:   </sysinfo>
Apr 14 14:47:19 user nova-compute[71347]:   <os>
Apr 14 14:47:19 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:47:19 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:47:19 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:47:19 user nova-compute[71347]:   </os>
Apr 14 14:47:19 user nova-compute[71347]:   <features>
Apr 14 14:47:19 user nova-compute[71347]:     <acpi/>
Apr 14 14:47:19 user nova-compute[71347]:     <apic/>
Apr 14 14:47:19 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:47:19 user nova-compute[71347]:   </features>
Apr 14 14:47:19 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:47:19 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:47:19 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:47:19 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:47:19 user nova-compute[71347]:   </clock>
Apr 14 14:47:19 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:47:19 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:47:19 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:47:19 user nova-compute[71347]:   </cpu>
Apr 14 14:47:19 user nova-compute[71347]:   <devices>
Apr 14 14:47:19 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:47:19 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:47:19 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:47:19 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:47:19 user nova-compute[71347]:       <serial>f69a7e0c-25ef-40b8-949d-a3d18bcc846c</serial>
Apr 14 14:47:19 user nova-compute[71347]:     </disk>
Apr 14 14:47:19 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:47:19 user nova-compute[71347]:       <mac address="fa:16:3e:fb:b9:72"/>
Apr 14 14:47:19 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:47:19 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:47:19 user nova-compute[71347]:       <target dev="tapa3103941-cf"/>
Apr 14 14:47:19 user nova-compute[71347]:     </interface>
Apr 14 14:47:19 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:47:19 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a3225314-c927-4d5d-871a-d80442c5f8a1/console.log" append="off"/>
Apr 14 14:47:19 user nova-compute[71347]:     </serial>
Apr 14 14:47:19 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:47:19 user nova-compute[71347]:     <video>
Apr 14 14:47:19 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:47:19 user nova-compute[71347]:     </video>
Apr 14 14:47:19 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:47:19 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:47:19 user nova-compute[71347]:     </rng>
Apr 14 14:47:19 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:47:19 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:47:19 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:47:19 user nova-compute[71347]:     </memballoon>
Apr 14 14:47:19 user nova-compute[71347]:   </devices>
Apr 14 14:47:19 user nova-compute[71347]: </domain>
Apr 14 14:47:19 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-510292440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-510292440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-510292440',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-r2sgevqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:47:13Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=a3225314-c927-4d5d-871a-d80442c5f8a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=a3103941-cf0f-49a8-a2a9-28decc5e0c04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3103941-cf') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG os_vif [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=a3103941-cf0f-49a8-a2a9-28decc5e0c04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3103941-cf') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3103941-cf, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3103941-cf, col_values=(('external_ids', {'iface-id': 'a3103941-cf0f-49a8-a2a9-28decc5e0c04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:b9:72', 'vm-uuid': 'a3225314-c927-4d5d-871a-d80442c5f8a1'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:19 user nova-compute[71347]: INFO os_vif [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=a3103941-cf0f-49a8-a2a9-28decc5e0c04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3103941-cf')
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No VIF found with MAC fa:16:3e:fb:b9:72, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:19 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:47:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received event network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] Acquiring lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG nova.compute.manager [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] No waiting events found dispatching network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:21 user nova-compute[71347]: WARNING nova.compute.manager [req-86489305-6b38-430d-8f5e-efb81f49e8aa req-023a0893-04e0-4b2a-b52a-bbe3d8cc77cd service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received unexpected event network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance with vm_state building and task_state spawning.
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:47:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:47:22 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:47:22 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8555MB free_disk=26.30970001220703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3225314-c927-4d5d-871a-d80442c5f8a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483642.902035, a3225314-c927-4d5d-871a-d80442c5f8a1 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:47:22 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] VM Resumed (Lifecycle Event)
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:47:22 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Instance spawned successfully.
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:47:22 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483642.905222, a3225314-c927-4d5d-871a-d80442c5f8a1 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:47:22 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] VM Started (Lifecycle Event)
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:47:22 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:47:22 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:47:22 user nova-compute[71347]: INFO nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 14 14:47:23 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:47:23 user nova-compute[71347]: INFO nova.compute.manager [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Took 10.25 seconds to build instance.
Apr 14 14:47:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-bf0087db-0c38-45fe-b3d4-9e55ebe8a7e0 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.339s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received event network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:47:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] Acquiring lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:47:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:47:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:47:23 user nova-compute[71347]: DEBUG nova.compute.manager [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] No waiting events found dispatching network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:47:23 user nova-compute[71347]: WARNING nova.compute.manager [req-913a655a-ec72-41ee-80a9-2cb6c19f6408 req-c884d5e0-0a09-45d3-af5d-0862ecb37d66 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received unexpected event network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance with vm_state active and task_state None.
Apr 14 14:47:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:47:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:47:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:47:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:47:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:47:26 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:47:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:47:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:47:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:47:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:47:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:47:36 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:47:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:47:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:48:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:17 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:17 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:48:19 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:48:20 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:48:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:48:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:48:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:48:21 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:48:21 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:48:21 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=26.308040618896484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:48:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3225314-c927-4d5d-871a-d80442c5f8a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:48:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:48:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:48:25 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:25 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:25 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:48:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:30 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:31 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:48:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:48:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:48:51 user nova-compute[71347]: INFO nova.compute.manager [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Unrescuing
Apr 14 14:48:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:48:51 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquired lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:48:51 user nova-compute[71347]: DEBUG nova.network.neutron [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Releasing lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG nova.objects.instance [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'flavor' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:48:52 user nova-compute[71347]: WARNING nova.compute.manager [req-bd2f2ae7-754c-46d5-b086-2a8f527f3fce req-4b12356e-bd74-40e0-a0c2-78412950ccfc service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:48:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance destroyed successfully.
Apr 14 14:48:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:48:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:48:54 user nova-compute[71347]: WARNING nova.compute.manager [req-c2e91ad2-6a35-4078-8dae-24b9c96ed3c0 req-f61cbf51-4492-4047-939e-b7eeb7ba7328 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:48:55 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for 43bcfbdd-5fc4-4c83-8d67-f660404766b2 due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483736.8461523, 43bcfbdd-5fc4-4c83-8d67-f660404766b2 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:48:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] VM Resumed (Lifecycle Event)
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-237d7b5d-7716-4d7e-81ca-19852fc4ec2a tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:48:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483736.8476279, 43bcfbdd-5fc4-4c83-8d67-f660404766b2 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:48:56 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] VM Started (Lifecycle Event)
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:48:56 user nova-compute[71347]: WARNING nova.compute.manager [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state None.
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:48:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:48:56 user nova-compute[71347]: WARNING nova.compute.manager [req-37432f00-8078-4a8e-a008-e5416e16c474 req-0285e5cb-d78f-4743-ae11-d606672f4e18 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state None.
Apr 14 14:48:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:48:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a36db897-6344-4e93-924e-ddf17ad61022" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:49:08 user nova-compute[71347]: INFO nova.compute.claims [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Claim successful on node user
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:49:08 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.network.neutron [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:49:08 user nova-compute[71347]: INFO nova.virt.block_device [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Booting with volume snapshot 2c27d055-a087-4312-85ef-99ec62ab93df at /dev/vda
Apr 14 14:49:08 user nova-compute[71347]: DEBUG nova.policy [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:49:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:49:09 user nova-compute[71347]: DEBUG nova.network.neutron [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Successfully created port: 0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:49:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Successfully updated port: 0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:49:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "refresh_cache-a36db897-6344-4e93-924e-ddf17ad61022" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:49:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquired lock "refresh_cache-a36db897-6344-4e93-924e-ddf17ad61022" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:49:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:49:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-changed-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:49:10 user nova-compute[71347]: DEBUG nova.compute.manager [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Refreshing instance network info cache due to event network-changed-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:49:10 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] Acquiring lock "refresh_cache-a36db897-6344-4e93-924e-ddf17ad61022" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:49:10 user nova-compute[71347]: DEBUG nova.network.neutron [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:49:11 user nova-compute[71347]: DEBUG nova.network.neutron [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Updating instance_info_cache with network_info: [{"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:49:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Releasing lock "refresh_cache-a36db897-6344-4e93-924e-ddf17ad61022" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:49:11 user nova-compute[71347]: DEBUG nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Instance network_info: |[{"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:49:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] Acquired lock "refresh_cache-a36db897-6344-4e93-924e-ddf17ad61022" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:49:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Refreshing network info cache for port 0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:49:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Updated VIF entry in instance network info cache for port 0f3e2c4b-c778-4fd3-a89a-62cc482a40a4. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:49:11 user nova-compute[71347]: DEBUG nova.network.neutron [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Updating instance_info_cache with network_info: [{"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:49:11 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-78a2b0fd-4c40-479f-8bd2-1a14c0eff458 req-38032c94-84cd-4203-aab5-be2fff43bdbf service nova] Releasing lock "refresh_cache-a36db897-6344-4e93-924e-ddf17ad61022" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG os_brick.utils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a047f294-64d2-4fc3-a0af-a6391f405534]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c10a3-62e3-4d57-ac04-46cc821edd27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1f81f4-2ff4-4565-b341-1e539a7766cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[784cefd8-60d5-4be6-8c22-11a7917203f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:49:14 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:49:14 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0f0bc2-0a56-4084-946d-884261cbb796]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG os_brick.utils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:49:14 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Updating existing volume attachment record: 7e45d0c0-feba-48eb-a525-ee079412262f {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:49:18 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:49:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:20 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:49:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:49:20 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:49:20 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:49:21 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:49:21 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=26.2994384765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3225314-c927-4d5d-871a-d80442c5f8a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a36db897-6344-4e93-924e-ddf17ad61022 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:49:21 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Creating image(s)
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Ensure instance console log exists: /opt/stack/data/nova/instances/a36db897-6344-4e93-924e-ddf17ad61022/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Start _get_guest_xml network_info=[{"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T14:49:04Z,direct_url=<?>,disk_format='qcow2',id=541a72c1-db43-43ba-95f6-cb3e6c2e97fa,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-5556420',owner='e217ba6818e94879aa02015ccf21b058',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T14:49:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXIlRwqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a36db897-6344-4e93-924e-ddf17ad61022', 'attached_at': '', 'detached_at': '', 'volume_id': '895c094e-46a0-4a85-a8ae-0ec0d75e008c', 'serial': '895c094e-46a0-4a85-a8ae-0ec0d75e008c'}, 'attachment_id': '7e45d0c0-feba-48eb-a525-ee079412262f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:49:21 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:49:21 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T14:49:04Z,direct_url=<?>,disk_format='qcow2',id=541a72c1-db43-43ba-95f6-cb3e6c2e97fa,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-5556420',owner='e217ba6818e94879aa02015ccf21b058',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T14:49:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:49:21 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXIlRwqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:49:22 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:49:22 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:49:22 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8112d230-526d-46bc-a6f4-c528271e192e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:49:22 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae07c85-a05e-4a56-bd77-e5b0ce797fb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c] added
Apr 14 14:49:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4522660a-06be-41e7-8ac6-09be21148890]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[737ed2e1-dafa-42e2-bf73-9eb398b87592]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kXIlRwqh {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kXIlRwqh" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[88705358-224e-4697-962d-384d8f8dcfc2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kXIlRwqh'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[878e98e7-0760-43c4-aa74-7746521a1dd5]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc828370-ee21-4306-b094-7cfbd946a1e5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:49:22 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:49:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:49:22 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:49:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a15cb6-4578-42c0-a272-da3433d40b34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c, portal: 172.16.0.220,3260]
Apr 14 14:49:22 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c, portal: 172.16.0.220,3260] successful.
Apr 14 14:49:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88d4a42-4c16-401c-b497-a3a8383f98c9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aef416-43b5-47b3-ae05-2ccec9cfd65b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:49:22 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:49:22 user nova-compute[71347]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c (non-flash)
Apr 14 14:49:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:49:22 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:49:22 user nova-compute[71347]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c (non-flash)
Apr 14 14:49:22 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86af595-4d7a-4cea-a220-cf47c0464928]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:49:22 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXIlRwqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23430333962366335', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430333962366335', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2123192446',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2123192446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2123192446',id=42,image_ref='541a72c1-db43-43ba-95f6-cb3e6c2e97fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-0pvwo5me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-152189831',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:49:09Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=a36db897-6344-4e93-924e-ddf17ad61022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:d9:76,bridge_name='br-int',has_traffic_filtering=True,id=0f3e2c4b-c778-4fd3-a89a-62cc482a40a4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3e2c4b-c7') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.objects.instance [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'pci_devices' on Instance uuid a36db897-6344-4e93-924e-ddf17ad61022 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:49:23 user nova-compute[71347]:   <uuid>a36db897-6344-4e93-924e-ddf17ad61022</uuid>
Apr 14 14:49:23 user nova-compute[71347]:   <name>instance-0000002a</name>
Apr 14 14:49:23 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:49:23 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:49:23 user nova-compute[71347]:   <metadata>
Apr 14 14:49:23 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:49:23 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:49:23 user nova-compute[71347]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2123192446</nova:name>
Apr 14 14:49:23 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:49:21</nova:creationTime>
Apr 14 14:49:23 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:49:23 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:49:23 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:49:23 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:49:23 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:49:23 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:49:23 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:49:23 user nova-compute[71347]:       <nova:owner>
Apr 14 14:49:23 user nova-compute[71347]:         <nova:user uuid="43b5d8526a7c4b0fb5f15a8345b229e2">tempest-TestVolumeBootPattern-152189831-project-member</nova:user>
Apr 14 14:49:23 user nova-compute[71347]:         <nova:project uuid="e217ba6818e94879aa02015ccf21b058">tempest-TestVolumeBootPattern-152189831</nova:project>
Apr 14 14:49:23 user nova-compute[71347]:       </nova:owner>
Apr 14 14:49:23 user nova-compute[71347]:       <nova:root type="image" uuid="541a72c1-db43-43ba-95f6-cb3e6c2e97fa"/>
Apr 14 14:49:23 user nova-compute[71347]:       <nova:ports>
Apr 14 14:49:23 user nova-compute[71347]:         <nova:port uuid="0f3e2c4b-c778-4fd3-a89a-62cc482a40a4">
Apr 14 14:49:23 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 14:49:23 user nova-compute[71347]:         </nova:port>
Apr 14 14:49:23 user nova-compute[71347]:       </nova:ports>
Apr 14 14:49:23 user nova-compute[71347]:     </nova:instance>
Apr 14 14:49:23 user nova-compute[71347]:   </metadata>
Apr 14 14:49:23 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:49:23 user nova-compute[71347]:     <system>
Apr 14 14:49:23 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:49:23 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:49:23 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:49:23 user nova-compute[71347]:       <entry name="serial">a36db897-6344-4e93-924e-ddf17ad61022</entry>
Apr 14 14:49:23 user nova-compute[71347]:       <entry name="uuid">a36db897-6344-4e93-924e-ddf17ad61022</entry>
Apr 14 14:49:23 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:49:23 user nova-compute[71347]:     </system>
Apr 14 14:49:23 user nova-compute[71347]:   </sysinfo>
Apr 14 14:49:23 user nova-compute[71347]:   <os>
Apr 14 14:49:23 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:49:23 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:49:23 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:49:23 user nova-compute[71347]:   </os>
Apr 14 14:49:23 user nova-compute[71347]:   <features>
Apr 14 14:49:23 user nova-compute[71347]:     <acpi/>
Apr 14 14:49:23 user nova-compute[71347]:     <apic/>
Apr 14 14:49:23 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:49:23 user nova-compute[71347]:   </features>
Apr 14 14:49:23 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:49:23 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:49:23 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:49:23 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:49:23 user nova-compute[71347]:   </clock>
Apr 14 14:49:23 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:49:23 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:49:23 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:49:23 user nova-compute[71347]:   </cpu>
Apr 14 14:49:23 user nova-compute[71347]:   <devices>
Apr 14 14:49:23 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:49:23 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:49:23 user nova-compute[71347]:       <source dev="/dev/sdd"/>
Apr 14 14:49:23 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:49:23 user nova-compute[71347]:       <serial>895c094e-46a0-4a85-a8ae-0ec0d75e008c</serial>
Apr 14 14:49:23 user nova-compute[71347]:     </disk>
Apr 14 14:49:23 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:49:23 user nova-compute[71347]:       <mac address="fa:16:3e:82:d9:76"/>
Apr 14 14:49:23 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:49:23 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:49:23 user nova-compute[71347]:       <target dev="tap0f3e2c4b-c7"/>
Apr 14 14:49:23 user nova-compute[71347]:     </interface>
Apr 14 14:49:23 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:49:23 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/a36db897-6344-4e93-924e-ddf17ad61022/console.log" append="off"/>
Apr 14 14:49:23 user nova-compute[71347]:     </serial>
Apr 14 14:49:23 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:49:23 user nova-compute[71347]:     <video>
Apr 14 14:49:23 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:49:23 user nova-compute[71347]:     </video>
Apr 14 14:49:23 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:49:23 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:49:23 user nova-compute[71347]:     </rng>
Apr 14 14:49:23 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:49:23 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:49:23 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:49:23 user nova-compute[71347]:     </memballoon>
Apr 14 14:49:23 user nova-compute[71347]:   </devices>
Apr 14 14:49:23 user nova-compute[71347]: </domain>
Apr 14 14:49:23 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2123192446',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2123192446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2123192446',id=42,image_ref='541a72c1-db43-43ba-95f6-cb3e6c2e97fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-0pvwo5me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-152189831',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:49:09Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=a36db897-6344-4e93-924e-ddf17ad61022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:d9:76,bridge_name='br-int',has_traffic_filtering=True,id=0f3e2c4b-c778-4fd3-a89a-62cc482a40a4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3e2c4b-c7') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG os_vif [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d9:76,bridge_name='br-int',has_traffic_filtering=True,id=0f3e2c4b-c778-4fd3-a89a-62cc482a40a4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3e2c4b-c7') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f3e2c4b-c7, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f3e2c4b-c7, col_values=(('external_ids', {'iface-id': '0f3e2c4b-c778-4fd3-a89a-62cc482a40a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:d9:76', 'vm-uuid': 'a36db897-6344-4e93-924e-ddf17ad61022'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:23 user nova-compute[71347]: INFO os_vif [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d9:76,bridge_name='br-int',has_traffic_filtering=True,id=0f3e2c4b-c778-4fd3-a89a-62cc482a40a4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3e2c4b-c7')
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:49:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No VIF found with MAC fa:16:3e:82:d9:76, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:49:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:49:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:49:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:49:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:49:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] No waiting events found dispatching network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:49:24 user nova-compute[71347]: WARNING nova.compute.manager [req-a28f7bc0-6bec-41e9-bab9-484f9b64bd73 req-80485bef-f4f1-4a11-bea7-e69ed00dfb14 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received unexpected event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance with vm_state building and task_state spawning.
Apr 14 14:49:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483766.8669562, a36db897-6344-4e93-924e-ddf17ad61022 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:49:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] VM Resumed (Lifecycle Event)
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:49:26 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Instance spawned successfully.
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:49:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483766.8684678, a36db897-6344-4e93-924e-ddf17ad61022 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:49:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] VM Started (Lifecycle Event)
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] No waiting events found dispatching network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:49:26 user nova-compute[71347]: WARNING nova.compute.manager [req-30f75a0c-cb3b-45e0-93c6-ee95a84deaa3 req-f8589a76-db56-4d4a-b034-6581a53b3683 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received unexpected event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance with vm_state building and task_state spawning.
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:49:26 user nova-compute[71347]: INFO nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Took 4.98 seconds to spawn the instance on the hypervisor.
Apr 14 14:49:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:49:26 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:49:27 user nova-compute[71347]: INFO nova.compute.manager [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Took 18.75 seconds to build instance.
Apr 14 14:49:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-52656df6-cdc0-412f-9427-a070891f3c08 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a36db897-6344-4e93-924e-ddf17ad61022" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.866s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Updating instance_info_cache with network_info: [{"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-a3225314-c927-4d5d-871a-d80442c5f8a1" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:49:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:28 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:31 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:37 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:49:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:49:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:49:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:49:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:49:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:49:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:50:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:50:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:50:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:21 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:22 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:22 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:23 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:50:23 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=26.298057556152344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3225314-c927-4d5d-871a-d80442c5f8a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a36db897-6344-4e93-924e-ddf17ad61022 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:50:23 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:50:24 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:50:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:50:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:50:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:50:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:50:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:50:31 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:31 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:50:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:50:44 user nova-compute[71347]: INFO nova.compute.claims [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Claim successful on node user
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:50:44 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.policy [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:50:44 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Creating image(s)
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "/opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "/opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "/opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.128s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk 1073741824" returned: 0 in 0.061s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "183d6891d9bc62aa0c868f03557e79ee2893ba9d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk. size=1073741824 {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG nova.virt.disk.api [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Cannot resize image /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk to a smaller size. {{(pid=71347) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'migration_context' on Instance uuid 56e1230b-ac3c-4234-96ff-c3731f7b8218 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Ensure instance console log exists: /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:45 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Successfully created port: 08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Successfully updated port: 08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquired lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-changed-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Refreshing instance network info cache due to event network-changed-08093479-30c5-4e51-a7fd-5e6e1a3382b6. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] Acquiring lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.neutron [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Updating instance_info_cache with network_info: [{"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Releasing lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Instance network_info: |[{"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] Acquired lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.neutron [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Refreshing network info cache for port 08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Start _get_guest_xml network_info=[{"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '79416463-b265-4588-8d03-bcb84f0ecc83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:50:46 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:50:46 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-170009530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-170009530',id=43,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-nob0bvvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:50:44Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=56e1230b-ac3c-4234-96ff-c3731f7b8218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:70:1e,bridge_name='br-int',has_traffic_filtering=True,id=08093479-30c5-4e51-a7fd-5e6e1a3382b6,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08093479-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.objects.instance [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'pci_devices' on Instance uuid 56e1230b-ac3c-4234-96ff-c3731f7b8218 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:50:46 user nova-compute[71347]:   <uuid>56e1230b-ac3c-4234-96ff-c3731f7b8218</uuid>
Apr 14 14:50:46 user nova-compute[71347]:   <name>instance-0000002b</name>
Apr 14 14:50:46 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:50:46 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:50:46 user nova-compute[71347]:   <metadata>
Apr 14 14:50:46 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:50:46 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:50:46 user nova-compute[71347]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-170009530</nova:name>
Apr 14 14:50:46 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:50:46</nova:creationTime>
Apr 14 14:50:46 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:50:46 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:50:46 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:50:46 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:50:46 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:50:46 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:50:46 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:50:46 user nova-compute[71347]:       <nova:owner>
Apr 14 14:50:46 user nova-compute[71347]:         <nova:user uuid="2e321f85d3d44c2baf210a1962f4f08f">tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member</nova:user>
Apr 14 14:50:46 user nova-compute[71347]:         <nova:project uuid="2241300ad3704734aed3990cc7aadc1b">tempest-ServerBootFromVolumeStableRescueTest-2086147649</nova:project>
Apr 14 14:50:46 user nova-compute[71347]:       </nova:owner>
Apr 14 14:50:46 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:50:46 user nova-compute[71347]:       <nova:ports>
Apr 14 14:50:46 user nova-compute[71347]:         <nova:port uuid="08093479-30c5-4e51-a7fd-5e6e1a3382b6">
Apr 14 14:50:46 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 14:50:46 user nova-compute[71347]:         </nova:port>
Apr 14 14:50:46 user nova-compute[71347]:       </nova:ports>
Apr 14 14:50:46 user nova-compute[71347]:     </nova:instance>
Apr 14 14:50:46 user nova-compute[71347]:   </metadata>
Apr 14 14:50:46 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:50:46 user nova-compute[71347]:     <system>
Apr 14 14:50:46 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:50:46 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:50:46 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:50:46 user nova-compute[71347]:       <entry name="serial">56e1230b-ac3c-4234-96ff-c3731f7b8218</entry>
Apr 14 14:50:46 user nova-compute[71347]:       <entry name="uuid">56e1230b-ac3c-4234-96ff-c3731f7b8218</entry>
Apr 14 14:50:46 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:50:46 user nova-compute[71347]:     </system>
Apr 14 14:50:46 user nova-compute[71347]:   </sysinfo>
Apr 14 14:50:46 user nova-compute[71347]:   <os>
Apr 14 14:50:46 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:50:46 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:50:46 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:50:46 user nova-compute[71347]:   </os>
Apr 14 14:50:46 user nova-compute[71347]:   <features>
Apr 14 14:50:46 user nova-compute[71347]:     <acpi/>
Apr 14 14:50:46 user nova-compute[71347]:     <apic/>
Apr 14 14:50:46 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:50:46 user nova-compute[71347]:   </features>
Apr 14 14:50:46 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:50:46 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:50:46 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:50:46 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:50:46 user nova-compute[71347]:   </clock>
Apr 14 14:50:46 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:50:46 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:50:46 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:50:46 user nova-compute[71347]:   </cpu>
Apr 14 14:50:46 user nova-compute[71347]:   <devices>
Apr 14 14:50:46 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:50:46 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:50:46 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk"/>
Apr 14 14:50:46 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:50:46 user nova-compute[71347]:     </disk>
Apr 14 14:50:46 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:50:46 user nova-compute[71347]:       <mac address="fa:16:3e:f3:70:1e"/>
Apr 14 14:50:46 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:50:46 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:50:46 user nova-compute[71347]:       <target dev="tap08093479-30"/>
Apr 14 14:50:46 user nova-compute[71347]:     </interface>
Apr 14 14:50:46 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:50:46 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/console.log" append="off"/>
Apr 14 14:50:46 user nova-compute[71347]:     </serial>
Apr 14 14:50:46 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:50:46 user nova-compute[71347]:     <video>
Apr 14 14:50:46 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:50:46 user nova-compute[71347]:     </video>
Apr 14 14:50:46 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:50:46 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:50:46 user nova-compute[71347]:     </rng>
Apr 14 14:50:46 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:50:46 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:50:46 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:50:46 user nova-compute[71347]:     </memballoon>
Apr 14 14:50:46 user nova-compute[71347]:   </devices>
Apr 14 14:50:46 user nova-compute[71347]: </domain>
Apr 14 14:50:46 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-170009530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-170009530',id=43,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-nob0bvvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:50:44Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=56e1230b-ac3c-4234-96ff-c3731f7b8218,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:70:1e,bridge_name='br-int',has_traffic_filtering=True,id=08093479-30c5-4e51-a7fd-5e6e1a3382b6,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08093479-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG os_vif [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:70:1e,bridge_name='br-int',has_traffic_filtering=True,id=08093479-30c5-4e51-a7fd-5e6e1a3382b6,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08093479-30') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08093479-30, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08093479-30, col_values=(('external_ids', {'iface-id': '08093479-30c5-4e51-a7fd-5e6e1a3382b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:70:1e', 'vm-uuid': '56e1230b-ac3c-4234-96ff-c3731f7b8218'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:46 user nova-compute[71347]: INFO os_vif [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:70:1e,bridge_name='br-int',has_traffic_filtering=True,id=08093479-30c5-4e51-a7fd-5e6e1a3382b6,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08093479-30')
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No VIF found with MAC fa:16:3e:f3:70:1e, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.neutron [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Updated VIF entry in instance network info cache for port 08093479-30c5-4e51-a7fd-5e6e1a3382b6. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG nova.network.neutron [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Updating instance_info_cache with network_info: [{"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:50:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3907a7fd-7eff-4e31-90bb-6507f3143a87 req-4becaaf5-7c85-4e97-b9f5-a8bd4939ac23 service nova] Releasing lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:50:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:50:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:48 user nova-compute[71347]: DEBUG nova.compute.manager [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] No waiting events found dispatching network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:50:48 user nova-compute[71347]: WARNING nova.compute.manager [req-7d2948a5-21ef-414a-9a20-178c3670de1c req-da4bb4cf-bf47-4dde-9554-54df8e8f180e service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received unexpected event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance with vm_state building and task_state spawning.
Apr 14 14:50:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483850.1205535, 56e1230b-ac3c-4234-96ff-c3731f7b8218 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:50:50 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] VM Resumed (Lifecycle Event)
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:50:50 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Instance spawned successfully.
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:50:50 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483850.121966, 56e1230b-ac3c-4234-96ff-c3731f7b8218 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:50:50 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] VM Started (Lifecycle Event)
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:50:50 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:50:50 user nova-compute[71347]: INFO nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Took 5.73 seconds to spawn the instance on the hypervisor.
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:50 user nova-compute[71347]: DEBUG nova.compute.manager [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] No waiting events found dispatching network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:50:50 user nova-compute[71347]: WARNING nova.compute.manager [req-e1491286-0c73-4ef0-a046-f905c181d7fe req-20eb16dd-9742-4731-9c64-28aed781683a service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received unexpected event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance with vm_state building and task_state spawning.
Apr 14 14:50:50 user nova-compute[71347]: INFO nova.compute.manager [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Took 6.31 seconds to build instance.
Apr 14 14:50:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-f7dff076-5673-4d30-9e1a-b9be20348af6 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.400s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:51 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a36db897-6344-4e93-924e-ddf17ad61022" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:58 user nova-compute[71347]: INFO nova.compute.manager [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Terminating instance
Apr 14 14:50:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-unplugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] No waiting events found dispatching network-vif-unplugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:50:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-39337e80-e1b3-44d5-9e7d-4e7f710a9d49 req-4e20ee0c-02ea-4ca5-85fd-a6f991ad72e4 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-unplugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Instance destroyed successfully.
Apr 14 14:50:59 user nova-compute[71347]: DEBUG nova.objects.instance [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'resources' on Instance uuid a36db897-6344-4e93-924e-ddf17ad61022 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:49:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2123192446',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2123192446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2123192446',id=42,image_ref='541a72c1-db43-43ba-95f6-cb3e6c2e97fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:49:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-0pvwo5me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-152189831',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:49:27Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=a36db897-6344-4e93-924e-ddf17ad61022,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "address": "fa:16:3e:82:d9:76", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3e2c4b-c7", "ovs_interfaceid": "0f3e2c4b-c778-4fd3-a89a-62cc482a40a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:d9:76,bridge_name='br-int',has_traffic_filtering=True,id=0f3e2c4b-c778-4fd3-a89a-62cc482a40a4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3e2c4b-c7') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_vif [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d9:76,bridge_name='br-int',has_traffic_filtering=True,id=0f3e2c4b-c778-4fd3-a89a-62cc482a40a4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3e2c4b-c7') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f3e2c4b-c7, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:50:59 user nova-compute[71347]: INFO os_vif [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d9:76,bridge_name='br-int',has_traffic_filtering=True,id=0f3e2c4b-c778-4fd3-a89a-62cc482a40a4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3e2c4b-c7')
Apr 14 14:50:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXIlRwqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:50:59 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1dc2f6-7679-40f7-b1a8-c6f75cfc503b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:50:59 user nova-compute[71347]: No targets found.
Apr 14 14:50:59 user nova-compute[71347]: iSNS:
Apr 14 14:50:59 user nova-compute[71347]: No targets found.
Apr 14 14:50:59 user nova-compute[71347]: STATIC:
Apr 14 14:50:59 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c
Apr 14 14:50:59 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:50:59 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:50:59 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c
Apr 14 14:50:59 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:50:59 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:50:59 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 14:50:59 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:50:59 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:50:59 user nova-compute[71347]: FIRMWARE:
Apr 14 14:50:59 user nova-compute[71347]: No targets found.
Apr 14 14:50:59 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:50:59 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:50:59 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[235af474-f437-469e-afd9-8f48bdb96fe9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b294b5-22ad-4348-abdc-4418a1374d17]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:50:59 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:50:59 user nova-compute[71347]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c (non-flash)
Apr 14 14:50:59 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:50:59 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:50:59 user nova-compute[71347]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c (non-flash)
Apr 14 14:50:59 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f50077ac700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[005a5708-673a-4828-a162-fc47f3c73032]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0755a2e3-0728-4f67-abcc-1cb0b2a47faa]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79f3758-2c4d-440b-ab14-05a3cb79eefd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c82b34e-9149-456d-897e-abdde7cf2834]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[973969f3-2432-48e5-9f87-7b5d87b4d505]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5ad7f4-fb96-4a7d-8c99-6978b86cfc76]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c, portal: 172.16.0.220,3260]
Apr 14 14:50:59 user nova-compute[71347]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c, portal: 172.16.0.220,3260] successful.
Apr 14 14:50:59 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:895c094e-46a0-4a85-a8ae-0ec0d75e008c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a735c0-2b66-47d8-8996-46c53fddcdc9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== disconnect_volume: return (349ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:50:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Deleting instance files /opt/stack/data/nova/instances/a36db897-6344-4e93-924e-ddf17ad61022_del
Apr 14 14:50:59 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Deletion of /opt/stack/data/nova/instances/a36db897-6344-4e93-924e-ddf17ad61022_del complete
Apr 14 14:50:59 user nova-compute[71347]: INFO nova.compute.manager [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 14 14:50:59 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a36db897-6344-4e93-924e-ddf17ad61022] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:50:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:00 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:51:00 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Took 0.53 seconds to deallocate network for instance.
Apr 14 14:51:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-1fe64cb2-3098-4fdc-907c-cbb84e26c069 req-433e9700-9b0c-4dc7-9f32-8a5d0d3afec3 service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-deleted-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] No waiting events found dispatching network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:51:01 user nova-compute[71347]: WARNING nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received unexpected event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance with vm_state active and task_state deleting.
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] No waiting events found dispatching network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:51:01 user nova-compute[71347]: WARNING nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received unexpected event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance with vm_state active and task_state deleting.
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] No waiting events found dispatching network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:51:01 user nova-compute[71347]: WARNING nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received unexpected event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance with vm_state active and task_state deleting.
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-unplugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] No waiting events found dispatching network-vif-unplugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-unplugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Acquiring lock "a36db897-6344-4e93-924e-ddf17ad61022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] Lock "a36db897-6344-4e93-924e-ddf17ad61022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] No waiting events found dispatching network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:51:01 user nova-compute[71347]: WARNING nova.compute.manager [req-5f6af301-042a-4f15-b34d-74fb11c1ae6b req-5c48b36c-c0a1-445e-96ea-390d55a8488c service nova] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Received unexpected event network-vif-plugged-0f3e2c4b-c778-4fd3-a89a-62cc482a40a4 for instance with vm_state active and task_state deleting.
Apr 14 14:51:01 user nova-compute[71347]: INFO nova.compute.manager [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Took 0.84 seconds to detach 1 volumes for instance.
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.manager [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Deleting volume: 895c094e-46a0-4a85-a8ae-0ec0d75e008c {{(pid=71347) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:01 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Deleted allocations for instance a36db897-6344-4e93-924e-ddf17ad61022
Apr 14 14:51:01 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-db6c650e-ba90-4572-9e2b-dc3f07185620 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a36db897-6344-4e93-924e-ddf17ad61022" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.200s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:14 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483859.482628, a36db897-6344-4e93-924e-ddf17ad61022 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:51:14 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a36db897-6344-4e93-924e-ddf17ad61022] VM Stopped (Lifecycle Event)
Apr 14 14:51:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1f173ea9-089c-4913-a163-96092d530876 None None] [instance: a36db897-6344-4e93-924e-ddf17ad61022] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:51:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:19 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:21 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:51:24 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:51:24 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:51:24 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8552MB free_disk=26.276432037353516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance a3225314-c927-4d5d-871a-d80442c5f8a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:51:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:51:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:51:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:51:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:51:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:51:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:51:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:51:28 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:51:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:51:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:51:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:51:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:51:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:31 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:51:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:51:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:51:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:51:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:51:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:39 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:51:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:51:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:51:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:51:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:51:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:51:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:51:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:51:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:51:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "a3225314-c927-4d5d-871a-d80442c5f8a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:52 user nova-compute[71347]: INFO nova.compute.manager [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Terminating instance
Apr 14 14:51:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received event network-vif-unplugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] Acquiring lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] No waiting events found dispatching network-vif-unplugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.compute.manager [req-d93d73be-1edb-4c77-96ab-1e30b2ec3517 req-37a21d5a-fb35-419a-9612-5c117dbae669 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received event network-vif-unplugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Instance destroyed successfully.
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.objects.instance [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'resources' on Instance uuid a3225314-c927-4d5d-871a-d80442c5f8a1 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-510292440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-510292440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-510292440',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:47:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-r2sgevqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:47:23Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=a3225314-c927-4d5d-871a-d80442c5f8a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "address": "fa:16:3e:fb:b9:72", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3103941-cf", "ovs_interfaceid": "a3103941-cf0f-49a8-a2a9-28decc5e0c04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=a3103941-cf0f-49a8-a2a9-28decc5e0c04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3103941-cf') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_vif [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=a3103941-cf0f-49a8-a2a9-28decc5e0c04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3103941-cf') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3103941-cf, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:51:53 user nova-compute[71347]: INFO os_vif [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=a3103941-cf0f-49a8-a2a9-28decc5e0c04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3103941-cf')
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJTyrmlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:51:53 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b8226c-c7de-447c-a124-4d0f17548284]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:51:53 user nova-compute[71347]: No targets found.
Apr 14 14:51:53 user nova-compute[71347]: iSNS:
Apr 14 14:51:53 user nova-compute[71347]: No targets found.
Apr 14 14:51:53 user nova-compute[71347]: STATIC:
Apr 14 14:51:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c
Apr 14 14:51:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:51:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:51:53 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 14:51:53 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:51:53 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:51:53 user nova-compute[71347]: FIRMWARE:
Apr 14 14:51:53 user nova-compute[71347]: No targets found.
Apr 14 14:51:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:51:53 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:51:53 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[61630477-47b3-44f8-bdb5-83142c62112a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff22deb7-7b5a-4ac4-9785-e2c03b06d6b1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:51:53 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:51:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:51:53 user nova-compute[71347]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c (non-flash)
Apr 14 14:51:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ff81d1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[98feae15-09fa-4df3-add4-b5ed988ed665]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef49afa-5e19-4f82-882e-80900a17f356]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[93daa0c7-e012-45c9-9fbd-62d5a6ad09f7]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feca318-8b77-431d-8459-5358bd1b374c]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[738e3ade-0039-4a40-81fb-211567e29242]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcde3a9b-7cd6-43ab-850e-26819dc8ff27]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c, portal: 172.16.0.220,3260]
Apr 14 14:51:53 user nova-compute[71347]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c, portal: 172.16.0.220,3260] successful.
Apr 14 14:51:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f69a7e0c-25ef-40b8-949d-a3d18bcc846c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[31547f4b-c468-47fe-97a5-06181b71a7c3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== disconnect_volume: return (318ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:51:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Deleting instance files /opt/stack/data/nova/instances/a3225314-c927-4d5d-871a-d80442c5f8a1_del
Apr 14 14:51:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Deletion of /opt/stack/data/nova/instances/a3225314-c927-4d5d-871a-d80442c5f8a1_del complete
Apr 14 14:51:53 user nova-compute[71347]: INFO nova.compute.manager [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 14 14:51:53 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:51:53 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:51:54 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:51:54 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Took 0.61 seconds to deallocate network for instance.
Apr 14 14:51:54 user nova-compute[71347]: DEBUG nova.compute.manager [req-aba11763-2d48-4847-b6c1-aad1bae10e9c req-aa397474-f929-4ef7-b6a7-64551a96ee6c service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received event network-vif-deleted-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:55 user nova-compute[71347]: INFO nova.compute.manager [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 14:51:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Deleting volume: f69a7e0c-25ef-40b8-949d-a3d18bcc846c {{(pid=71347) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received event network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] Acquiring lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG nova.compute.manager [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] No waiting events found dispatching network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:51:55 user nova-compute[71347]: WARNING nova.compute.manager [req-4df0be45-3bba-4d5e-88ee-6f40b27f9651 req-18b7efc9-8ed5-4c49-922d-cf127c175b68 service nova] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Received unexpected event network-vif-plugged-a3103941-cf0f-49a8-a2a9-28decc5e0c04 for instance with vm_state active and task_state deleting.
Apr 14 14:51:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:51:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:55 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Deleted allocations for instance a3225314-c927-4d5d-871a-d80442c5f8a1
Apr 14 14:51:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d91f9a01-d627-40e2-8940-a8aaf5db6e98 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "a3225314-c927-4d5d-871a-d80442c5f8a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:51:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:08 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681483913.277435, a3225314-c927-4d5d-871a-d80442c5f8a1 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:52:08 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] VM Stopped (Lifecycle Event)
Apr 14 14:52:08 user nova-compute[71347]: DEBUG nova.compute.manager [None req-e9b9a572-ac1c-4052-984e-ce0099368885 None None] [instance: a3225314-c927-4d5d-871a-d80442c5f8a1] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:52:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:52:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:52:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:52:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:21 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:52:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:52:23 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:52:23 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:24 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:52:24 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:52:24 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=26.275474548339844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:52:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:52:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:52:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:52:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:52:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:52:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:52:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:52:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:52:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:34 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:52:35 user nova-compute[71347]: INFO nova.compute.manager [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] instance snapshotting
Apr 14 14:52:35 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Beginning live snapshot process
Apr 14 14:52:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json -f qcow2 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json -f qcow2 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d --force-share --output=json" returned: 0 in 0.147s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7fbs8jr7/d8bab7b9bcc548a595ef7929d9860449.delta 1073741824 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7fbs8jr7/d8bab7b9bcc548a595ef7929d9860449.delta 1073741824" returned: 0 in 0.054s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:36 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 14:52:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:52:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.guest [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71347) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 14:52:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 14:52:37 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:52:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7fbs8jr7/d8bab7b9bcc548a595ef7929d9860449.delta /opt/stack/data/nova/instances/snapshots/tmp7fbs8jr7/d8bab7b9bcc548a595ef7929d9860449 {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:38 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7fbs8jr7/d8bab7b9bcc548a595ef7929d9860449.delta /opt/stack/data/nova/instances/snapshots/tmp7fbs8jr7/d8bab7b9bcc548a595ef7929d9860449" returned: 0 in 0.412s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:38 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Snapshot extracted, beginning image upload
Apr 14 14:52:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:40 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Snapshot image upload complete
Apr 14 14:52:40 user nova-compute[71347]: INFO nova.compute.manager [None req-288d0e9f-609f-4576-95c1-1f9cffbfbab1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Took 4.70 seconds to snapshot the instance on the hypervisor.
Apr 14 14:52:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Verify base images {{(pid=71347) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Image id 79416463-b265-4588-8d03-bcb84f0ecc83 yields fingerprint 183d6891d9bc62aa0c868f03557e79ee2893ba9d {{(pid=71347) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 14:52:48 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] image 79416463-b265-4588-8d03-bcb84f0ecc83 at (/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d): checking
Apr 14 14:52:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] image 79416463-b265-4588-8d03-bcb84f0ecc83 at (/opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d): image is in use {{(pid=71347) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71347) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] 56e1230b-ac3c-4234-96ff-c3731f7b8218 is a valid instance name {{(pid=71347) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] 56e1230b-ac3c-4234-96ff-c3731f7b8218 has a disk file {{(pid=71347) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 14:52:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 is backed by 183d6891d9bc62aa0c868f03557e79ee2893ba9d {{(pid=71347) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] 43bcfbdd-5fc4-4c83-8d67-f660404766b2 is a valid instance name {{(pid=71347) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] 2bf7382e-7ffd-4f89-8b79-e8616462c61b is a valid instance name {{(pid=71347) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] 2bf7382e-7ffd-4f89-8b79-e8616462c61b has a disk file {{(pid=71347) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b is backed by 183d6891d9bc62aa0c868f03557e79ee2893ba9d {{(pid=71347) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 14:52:49 user nova-compute[71347]: WARNING nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Unknown base file: /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221
Apr 14 14:52:49 user nova-compute[71347]: WARNING nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Unknown base file: /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7
Apr 14 14:52:49 user nova-compute[71347]: WARNING nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Unknown base file: /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8
Apr 14 14:52:49 user nova-compute[71347]: WARNING nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67
Apr 14 14:52:49 user nova-compute[71347]: WARNING nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Unknown base file: /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6
Apr 14 14:52:49 user nova-compute[71347]: WARNING nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027
Apr 14 14:52:49 user nova-compute[71347]: WARNING nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52
Apr 14 14:52:49 user nova-compute[71347]: WARNING nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Active base files: /opt/stack/data/nova/instances/_base/183d6891d9bc62aa0c868f03557e79ee2893ba9d
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Removable base files: /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221 /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7 /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8 /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67 /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6 /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027 /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52 /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/29c9329f524353f40519aafc70bd78fe70da1221
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/93318da15a67c3a070e0f49dc44ebedae5c0f7b7
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/de308132653c08068e5f64538977a4289d4391c8
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7fb5cfeeec2333bcd5ced758de2b6e857a4caf67
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/59f024c375e5245aa1aa64bd540de008e9ddeed6
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c83b20313c9942ffcec13e8065bda03f67098027
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b9dbe58eed07d9b08a1d9fbc2df31847f3f77e52
Apr 14 14:52:49 user nova-compute[71347]: INFO nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f8520de6afc2d295576c15f7deb8e2496baa2a4c
Apr 14 14:52:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Verification complete {{(pid=71347) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Verify swap images {{(pid=71347) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 14 14:52:49 user nova-compute[71347]: DEBUG nova.virt.libvirt.imagecache [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Verify ephemeral images {{(pid=71347) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:52:50 user nova-compute[71347]: INFO nova.compute.claims [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Claim successful on node user
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:52:50 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:52:50 user nova-compute[71347]: INFO nova.virt.block_device [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Booting with volume c0e09208-c40e-4eee-b7e7-bd45c326e066 at /dev/vda
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.policy [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG os_brick.utils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff4ca69-beea-44e4-8968-d2d80bdca820]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f11088-8ac0-4469-a9fe-852dd514e3b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dafcaaa-ad48-48f4-ad48-1f3d9696d2c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af2947c-1b7b-4f08-8860-121ac52c7a15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:52:50 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:52:50 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827cd48-51bf-469b-a520-986187af800d]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG os_brick.utils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:52:50 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Updating existing volume attachment record: 3cc00c80-7c47-48cd-9158-239932008b41 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:52:51 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Successfully created port: e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Successfully updated port: e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquired lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received event network-changed-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG nova.compute.manager [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Refreshing instance network info cache due to event network-changed-e72fe350-d8b1-48d0-97a5-459536237a04. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] Acquiring lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Updating instance_info_cache with network_info: [{"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Releasing lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Instance network_info: |[{"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] Acquired lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:52:52 user nova-compute[71347]: DEBUG nova.network.neutron [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Refreshing network info cache for port e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:52:53 user nova-compute[71347]: DEBUG nova.network.neutron [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Updated VIF entry in instance network info cache for port e72fe350-d8b1-48d0-97a5-459536237a04. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:52:53 user nova-compute[71347]: DEBUG nova.network.neutron [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Updating instance_info_cache with network_info: [{"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:52:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-a9cfaf64-6f70-47af-88eb-6baf2b9b3f65 req-3c164221-f9d0-4677-b8f7-26077d21f1a0 service nova] Releasing lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:52:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:52:55 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Creating image(s)
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Ensure instance console log exists: /opt/stack/data/nova/instances/bb195da3-b027-4af6-9c2e-cb8728368d6a/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Start _get_guest_xml network_info=[{"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWqJOlEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb195da3-b027-4af6-9c2e-cb8728368d6a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0e09208-c40e-4eee-b7e7-bd45c326e066', 'serial': 'c0e09208-c40e-4eee-b7e7-bd45c326e066'}, 'attachment_id': '3cc00c80-7c47-48cd-9158-239932008b41', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:52:55 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:52:55 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWqJOlEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:52:55 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:52:55 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:52:55 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acb93f0-3bc8-4043-9c91-e7feb406e168]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:52:55 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a5d2ab-9062-4387-b785-9933ea4f54b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066] added
Apr 14 14:52:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a79d6-8be1-4aec-a339-e1f9c0c06a18]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bfcaad-6df7-495e-aa3d-2ed867f18284]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWqJOlEw {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWqJOlEw" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[18479216-c172-4a2d-9be3-e6dc86d7a904]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DWqJOlEw'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e456237-57d8-4514-ad08-4b63b4aed82e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b719e716-03c2-475e-903e-765966fa9de5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:52:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:52:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2171d3b-b10f-4080-97ea-b8dbfb858809]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260]
Apr 14 14:52:55 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260] successful.
Apr 14 14:52:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5776007-6b12-4aca-bb09-017347e83590]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3183377c-8aa0-4bfb-8de5-729aee7a544f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:52:55 user nova-compute[71347]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:52:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:52:55 user nova-compute[71347]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:52:55 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8a24a8-105e-4373-9700-18301ee7ee59]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:52:55 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWqJOlEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23564616132666430', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564616132666430', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-949359651',display_name='tempest-TestVolumeBootPattern-server-949359651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-949359651',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-2avx375e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:52:51Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=bb195da3-b027-4af6-9c2e-cb8728368d6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:fa:ad,bridge_name='br-int',has_traffic_filtering=True,id=e72fe350-d8b1-48d0-97a5-459536237a04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72fe350-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.objects.instance [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'pci_devices' on Instance uuid bb195da3-b027-4af6-9c2e-cb8728368d6a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:52:56 user nova-compute[71347]:   <uuid>bb195da3-b027-4af6-9c2e-cb8728368d6a</uuid>
Apr 14 14:52:56 user nova-compute[71347]:   <name>instance-0000002c</name>
Apr 14 14:52:56 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:52:56 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:52:56 user nova-compute[71347]:   <metadata>
Apr 14 14:52:56 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:52:56 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:52:56 user nova-compute[71347]:       <nova:name>tempest-TestVolumeBootPattern-server-949359651</nova:name>
Apr 14 14:52:56 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:52:55</nova:creationTime>
Apr 14 14:52:56 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:52:56 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:52:56 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:52:56 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:52:56 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:52:56 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:52:56 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:52:56 user nova-compute[71347]:       <nova:owner>
Apr 14 14:52:56 user nova-compute[71347]:         <nova:user uuid="43b5d8526a7c4b0fb5f15a8345b229e2">tempest-TestVolumeBootPattern-152189831-project-member</nova:user>
Apr 14 14:52:56 user nova-compute[71347]:         <nova:project uuid="e217ba6818e94879aa02015ccf21b058">tempest-TestVolumeBootPattern-152189831</nova:project>
Apr 14 14:52:56 user nova-compute[71347]:       </nova:owner>
Apr 14 14:52:56 user nova-compute[71347]:       <nova:ports>
Apr 14 14:52:56 user nova-compute[71347]:         <nova:port uuid="e72fe350-d8b1-48d0-97a5-459536237a04">
Apr 14 14:52:56 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 14:52:56 user nova-compute[71347]:         </nova:port>
Apr 14 14:52:56 user nova-compute[71347]:       </nova:ports>
Apr 14 14:52:56 user nova-compute[71347]:     </nova:instance>
Apr 14 14:52:56 user nova-compute[71347]:   </metadata>
Apr 14 14:52:56 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:52:56 user nova-compute[71347]:     <system>
Apr 14 14:52:56 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:52:56 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:52:56 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:52:56 user nova-compute[71347]:       <entry name="serial">bb195da3-b027-4af6-9c2e-cb8728368d6a</entry>
Apr 14 14:52:56 user nova-compute[71347]:       <entry name="uuid">bb195da3-b027-4af6-9c2e-cb8728368d6a</entry>
Apr 14 14:52:56 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:52:56 user nova-compute[71347]:     </system>
Apr 14 14:52:56 user nova-compute[71347]:   </sysinfo>
Apr 14 14:52:56 user nova-compute[71347]:   <os>
Apr 14 14:52:56 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:52:56 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:52:56 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:52:56 user nova-compute[71347]:   </os>
Apr 14 14:52:56 user nova-compute[71347]:   <features>
Apr 14 14:52:56 user nova-compute[71347]:     <acpi/>
Apr 14 14:52:56 user nova-compute[71347]:     <apic/>
Apr 14 14:52:56 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:52:56 user nova-compute[71347]:   </features>
Apr 14 14:52:56 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:52:56 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:52:56 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:52:56 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:52:56 user nova-compute[71347]:   </clock>
Apr 14 14:52:56 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:52:56 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:52:56 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:52:56 user nova-compute[71347]:   </cpu>
Apr 14 14:52:56 user nova-compute[71347]:   <devices>
Apr 14 14:52:56 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:52:56 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:52:56 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:52:56 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:52:56 user nova-compute[71347]:       <serial>c0e09208-c40e-4eee-b7e7-bd45c326e066</serial>
Apr 14 14:52:56 user nova-compute[71347]:     </disk>
Apr 14 14:52:56 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:52:56 user nova-compute[71347]:       <mac address="fa:16:3e:14:fa:ad"/>
Apr 14 14:52:56 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:52:56 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:52:56 user nova-compute[71347]:       <target dev="tape72fe350-d8"/>
Apr 14 14:52:56 user nova-compute[71347]:     </interface>
Apr 14 14:52:56 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:52:56 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/bb195da3-b027-4af6-9c2e-cb8728368d6a/console.log" append="off"/>
Apr 14 14:52:56 user nova-compute[71347]:     </serial>
Apr 14 14:52:56 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:52:56 user nova-compute[71347]:     <video>
Apr 14 14:52:56 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:52:56 user nova-compute[71347]:     </video>
Apr 14 14:52:56 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:52:56 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:52:56 user nova-compute[71347]:     </rng>
Apr 14 14:52:56 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:52:56 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:52:56 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:52:56 user nova-compute[71347]:     </memballoon>
Apr 14 14:52:56 user nova-compute[71347]:   </devices>
Apr 14 14:52:56 user nova-compute[71347]: </domain>
Apr 14 14:52:56 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-949359651',display_name='tempest-TestVolumeBootPattern-server-949359651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-949359651',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-2avx375e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:52:51Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=bb195da3-b027-4af6-9c2e-cb8728368d6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:fa:ad,bridge_name='br-int',has_traffic_filtering=True,id=e72fe350-d8b1-48d0-97a5-459536237a04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72fe350-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG os_vif [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:fa:ad,bridge_name='br-int',has_traffic_filtering=True,id=e72fe350-d8b1-48d0-97a5-459536237a04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72fe350-d8') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape72fe350-d8, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape72fe350-d8, col_values=(('external_ids', {'iface-id': 'e72fe350-d8b1-48d0-97a5-459536237a04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:fa:ad', 'vm-uuid': 'bb195da3-b027-4af6-9c2e-cb8728368d6a'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:52:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:52:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:57 user nova-compute[71347]: INFO os_vif [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:fa:ad,bridge_name='br-int',has_traffic_filtering=True,id=e72fe350-d8b1-48d0-97a5-459536237a04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72fe350-d8')
Apr 14 14:52:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:52:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No VIF found with MAC fa:16:3e:14:fa:ad, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received event network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] Acquiring lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] No waiting events found dispatching network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:52:58 user nova-compute[71347]: WARNING nova.compute.manager [req-e61cef61-def3-4835-b7d8-7e9adbd1cf72 req-aa723311-663e-405d-9bc6-11e7c6f5de50 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received unexpected event network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 for instance with vm_state building and task_state spawning.
Apr 14 14:52:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:52:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483980.3967388, bb195da3-b027-4af6-9c2e-cb8728368d6a => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:53:00 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] VM Resumed (Lifecycle Event)
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:53:00 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Instance spawned successfully.
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:00 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681483980.3993149, bb195da3-b027-4af6-9c2e-cb8728368d6a => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:53:00 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] VM Started (Lifecycle Event)
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:53:00 user nova-compute[71347]: INFO nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Took 4.90 seconds to spawn the instance on the hypervisor.
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:53:00 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:53:00 user nova-compute[71347]: INFO nova.compute.manager [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Took 10.26 seconds to build instance.
Apr 14 14:53:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d1d272dc-004c-420d-b0b3-e445de435926 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.352s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received event network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] Acquiring lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:00 user nova-compute[71347]: DEBUG nova.compute.manager [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] No waiting events found dispatching network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:53:00 user nova-compute[71347]: WARNING nova.compute.manager [req-9ff2fbfa-c9f5-4cf6-8864-c5701b2e7e3f req-c4e00238-e6b8-4ba0-95c9-bf1a98f592aa service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received unexpected event network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 for instance with vm_state active and task_state None.
Apr 14 14:53:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:53:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:53:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:53:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:53:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:53:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:24 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:25 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:53:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:53:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:26 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:53:26 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:53:26 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=26.237079620361328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:53:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance bb195da3-b027-4af6-9c2e-cb8728368d6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:53:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:28 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:53:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:53:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:53:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:53:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:53:28 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:53:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:53:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:53:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:53:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:30 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:53:32 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:53:34 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:53:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:53:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:53:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:53:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:53:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:53:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:53:42 user nova-compute[71347]: INFO nova.compute.claims [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Claim successful on node user
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:53:42 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:53:42 user nova-compute[71347]: INFO nova.virt.block_device [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Booting with volume-backed-image 79416463-b265-4588-8d03-bcb84f0ecc83 at /dev/vda
Apr 14 14:53:42 user nova-compute[71347]: DEBUG nova.policy [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e321f85d3d44c2baf210a1962f4f08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2241300ad3704734aed3990cc7aadc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:53:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:43 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Successfully created port: 0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:53:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Successfully updated port: 0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquired lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-changed-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Refreshing instance network info cache due to event network-changed-0e83d513-46c5-48cd-bcbe-9ae926f887a2. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] Acquiring lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Updating instance_info_cache with network_info: [{"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Releasing lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance network_info: |[{"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] Acquired lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:53:44 user nova-compute[71347]: DEBUG nova.network.neutron [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Refreshing network info cache for port 0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:53:45 user nova-compute[71347]: DEBUG nova.network.neutron [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Updated VIF entry in instance network info cache for port 0e83d513-46c5-48cd-bcbe-9ae926f887a2. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:53:45 user nova-compute[71347]: DEBUG nova.network.neutron [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Updating instance_info_cache with network_info: [{"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:53:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6eae38d0-884b-435d-a572-eb823f9edca6 req-a8bab17d-bed3-43a7-a40a-97d3f7c9dd2a service nova] Releasing lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:53:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG os_brick.utils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[715cef3a-a032-4985-8306-60128c3a9974]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ba6e0-0a9c-43bb-b5e4-dc80d31f0ffa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9c8b4a-b8a0-4f6f-8ce7-0996779e2407]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f4bc56-c4f0-40f3-a4ec-1b02f91861e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:53:48 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:53:48 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bd01ba-f770-465b-bfeb-4a968b4c4a7a]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG os_brick.utils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Updating existing volume attachment record: 88ef4c0b-49c3-46a3-afbf-50829a21b224 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:53:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:53:53 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Creating image(s)
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Ensure instance console log exists: /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Start _get_guest_xml network_info=[{"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUSLrGXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8325185-b8d9-410c-9da5-2ec5ee09620b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1126918-c0e8-4d10-9e16-96e368a479c8', 'serial': 'c1126918-c0e8-4d10-9e16-96e368a479c8'}, 'attachment_id': '88ef4c0b-49c3-46a3-afbf-50829a21b224', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:53:53 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:53:53 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUSLrGXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:53:53 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:53:53 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:53:53 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c5384f-16e4-45c0-9d75-8bb752fa92a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:53:53 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dd57df-3602-43e7-bb96-9b5a18b01199]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8] added
Apr 14 14:53:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2699f954-198c-491a-81f6-57b28e72c3d0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a40727-c646-41fd-88ec-8d0c10093321]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUSLrGXn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUSLrGXn" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ebc52a-f1d0-44e4-a5b5-5b95b4ce0c50]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUSLrGXn'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4702824a-f8b7-417e-8a6e-da911098590e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[869fae25-bff7-4475-b72b-a91d9dbd3849]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:53:53 user nova-compute[71347]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:53:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:53:53 user nova-compute[71347]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:53:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc7fa7-5dd5-45bb-bae9-5599878e46ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8, portal: 172.16.0.220,3260]
Apr 14 14:53:53 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8, portal: 172.16.0.220,3260] successful.
Apr 14 14:53:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d0daa-f0c1-4aa1-aabd-6c2736eac524]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dddc32d-d4d8-4772-baf8-68f624dc4b5c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:53:53 user nova-compute[71347]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:53:53 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:53:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:53:53 user nova-compute[71347]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:53:53 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:53:53 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1ac0a3-3d63-499e-abee-e20cd71695cb]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:53:53 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUSLrGXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23664623830336632', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664623830336632', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469413864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469413864',id=45,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-tu6wx54m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:53:43Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=e8325185-b8d9-410c-9da5-2ec5ee09620b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=0e83d513-46c5-48cd-bcbe-9ae926f887a2,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e83d513-46') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'pci_devices' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:53:54 user nova-compute[71347]:   <uuid>e8325185-b8d9-410c-9da5-2ec5ee09620b</uuid>
Apr 14 14:53:54 user nova-compute[71347]:   <name>instance-0000002d</name>
Apr 14 14:53:54 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:53:54 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:53:54 user nova-compute[71347]:   <metadata>
Apr 14 14:53:54 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:53:54 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:53:54 user nova-compute[71347]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1469413864</nova:name>
Apr 14 14:53:54 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:53:53</nova:creationTime>
Apr 14 14:53:54 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:53:54 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:53:54 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:53:54 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:53:54 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:53:54 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:53:54 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:53:54 user nova-compute[71347]:       <nova:owner>
Apr 14 14:53:54 user nova-compute[71347]:         <nova:user uuid="2e321f85d3d44c2baf210a1962f4f08f">tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member</nova:user>
Apr 14 14:53:54 user nova-compute[71347]:         <nova:project uuid="2241300ad3704734aed3990cc7aadc1b">tempest-ServerBootFromVolumeStableRescueTest-2086147649</nova:project>
Apr 14 14:53:54 user nova-compute[71347]:       </nova:owner>
Apr 14 14:53:54 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:53:54 user nova-compute[71347]:       <nova:ports>
Apr 14 14:53:54 user nova-compute[71347]:         <nova:port uuid="0e83d513-46c5-48cd-bcbe-9ae926f887a2">
Apr 14 14:53:54 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 14:53:54 user nova-compute[71347]:         </nova:port>
Apr 14 14:53:54 user nova-compute[71347]:       </nova:ports>
Apr 14 14:53:54 user nova-compute[71347]:     </nova:instance>
Apr 14 14:53:54 user nova-compute[71347]:   </metadata>
Apr 14 14:53:54 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:53:54 user nova-compute[71347]:     <system>
Apr 14 14:53:54 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:53:54 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:53:54 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:53:54 user nova-compute[71347]:       <entry name="serial">e8325185-b8d9-410c-9da5-2ec5ee09620b</entry>
Apr 14 14:53:54 user nova-compute[71347]:       <entry name="uuid">e8325185-b8d9-410c-9da5-2ec5ee09620b</entry>
Apr 14 14:53:54 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:53:54 user nova-compute[71347]:     </system>
Apr 14 14:53:54 user nova-compute[71347]:   </sysinfo>
Apr 14 14:53:54 user nova-compute[71347]:   <os>
Apr 14 14:53:54 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:53:54 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:53:54 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:53:54 user nova-compute[71347]:   </os>
Apr 14 14:53:54 user nova-compute[71347]:   <features>
Apr 14 14:53:54 user nova-compute[71347]:     <acpi/>
Apr 14 14:53:54 user nova-compute[71347]:     <apic/>
Apr 14 14:53:54 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:53:54 user nova-compute[71347]:   </features>
Apr 14 14:53:54 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:53:54 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:53:54 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:53:54 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:53:54 user nova-compute[71347]:   </clock>
Apr 14 14:53:54 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:53:54 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:53:54 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:53:54 user nova-compute[71347]:   </cpu>
Apr 14 14:53:54 user nova-compute[71347]:   <devices>
Apr 14 14:53:54 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:53:54 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:53:54 user nova-compute[71347]:       <source dev="/dev/sdd"/>
Apr 14 14:53:54 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:53:54 user nova-compute[71347]:       <serial>c1126918-c0e8-4d10-9e16-96e368a479c8</serial>
Apr 14 14:53:54 user nova-compute[71347]:     </disk>
Apr 14 14:53:54 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:53:54 user nova-compute[71347]:       <mac address="fa:16:3e:e5:8a:da"/>
Apr 14 14:53:54 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:53:54 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:53:54 user nova-compute[71347]:       <target dev="tap0e83d513-46"/>
Apr 14 14:53:54 user nova-compute[71347]:     </interface>
Apr 14 14:53:54 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:53:54 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/console.log" append="off"/>
Apr 14 14:53:54 user nova-compute[71347]:     </serial>
Apr 14 14:53:54 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:53:54 user nova-compute[71347]:     <video>
Apr 14 14:53:54 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:53:54 user nova-compute[71347]:     </video>
Apr 14 14:53:54 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:53:54 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:53:54 user nova-compute[71347]:     </rng>
Apr 14 14:53:54 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:53:54 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:53:54 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:53:54 user nova-compute[71347]:     </memballoon>
Apr 14 14:53:54 user nova-compute[71347]:   </devices>
Apr 14 14:53:54 user nova-compute[71347]: </domain>
Apr 14 14:53:54 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469413864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469413864',id=45,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-tu6wx54m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:53:43Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=e8325185-b8d9-410c-9da5-2ec5ee09620b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=0e83d513-46c5-48cd-bcbe-9ae926f887a2,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e83d513-46') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG os_vif [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=0e83d513-46c5-48cd-bcbe-9ae926f887a2,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e83d513-46') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e83d513-46, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e83d513-46, col_values=(('external_ids', {'iface-id': '0e83d513-46c5-48cd-bcbe-9ae926f887a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:8a:da', 'vm-uuid': 'e8325185-b8d9-410c-9da5-2ec5ee09620b'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:54 user nova-compute[71347]: INFO os_vif [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=0e83d513-46c5-48cd-bcbe-9ae926f887a2,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e83d513-46')
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:53:54 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No VIF found with MAC fa:16:3e:e5:8a:da, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.020s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.021s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:53:56 user nova-compute[71347]: WARNING nova.compute.manager [req-4d202acc-a338-4a25-af68-be5312357632 req-9eb6dca1-e0da-45b3-b8d0-13024692bd84 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state building and task_state spawning.
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484038.1669629, e8325185-b8d9-410c-9da5-2ec5ee09620b => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:53:58 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] VM Resumed (Lifecycle Event)
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:53:58 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance spawned successfully.
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:53:58 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484038.1707373, e8325185-b8d9-410c-9da5-2ec5ee09620b => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:53:58 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] VM Started (Lifecycle Event)
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:53:58 user nova-compute[71347]: INFO nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Took 4.99 seconds to spawn the instance on the hypervisor.
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:53:58 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:53:58 user nova-compute[71347]: INFO nova.compute.manager [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Took 16.10 seconds to build instance.
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:53:58 user nova-compute[71347]: WARNING nova.compute.manager [req-e49da10d-48e4-47ce-b3d1-9647a602942e req-c30ddb94-cd36-4cb1-9b9a-ade60bae345c service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state None.
Apr 14 14:53:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2865af5b-4671-4de9-9e3f-9453ff458a7f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.190s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:53:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:53:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:54:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:54:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:54:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:54:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:54:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:25 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:54:27 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:54:27 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8457MB free_disk=26.23522186279297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance bb195da3-b027-4af6-9c2e-cb8728368d6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e8325185-b8d9-410c-9da5-2ec5ee09620b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:54:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:28 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:54:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:54:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:54:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:54:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:54:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:54:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:54:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid 56e1230b-ac3c-4234-96ff-c3731f7b8218 {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid bb195da3-b027-4af6-9c2e-cb8728368d6a {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Triggering sync for uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:31 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:54:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:54:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:54:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:54:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:54:36 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:37 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:54:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:54:41 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received event network-changed-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG nova.compute.manager [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Refreshing instance network info cache due to event network-changed-e72fe350-d8b1-48d0-97a5-459536237a04. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] Acquiring lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] Acquired lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG nova.network.neutron [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Refreshing network info cache for port e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:42 user nova-compute[71347]: INFO nova.compute.manager [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Terminating instance
Apr 14 14:54:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:54:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG nova.network.neutron [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Updated VIF entry in instance network info cache for port e72fe350-d8b1-48d0-97a5-459536237a04. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG nova.network.neutron [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Updating instance_info_cache with network_info: [{"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-294c090d-03af-4d8a-9f39-04b83a953921 req-91b228a2-db6e-4293-b922-c9b80d2536aa service nova] Releasing lock "refresh_cache-bb195da3-b027-4af6-9c2e-cb8728368d6a" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:54:43 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Instance destroyed successfully.
Apr 14 14:54:43 user nova-compute[71347]: DEBUG nova.objects.instance [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'resources' on Instance uuid bb195da3-b027-4af6-9c2e-cb8728368d6a {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-949359651',display_name='tempest-TestVolumeBootPattern-server-949359651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-949359651',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-2avx375e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:53:01Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=bb195da3-b027-4af6-9c2e-cb8728368d6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "e72fe350-d8b1-48d0-97a5-459536237a04", "address": "fa:16:3e:14:fa:ad", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape72fe350-d8", "ovs_interfaceid": "e72fe350-d8b1-48d0-97a5-459536237a04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:fa:ad,bridge_name='br-int',has_traffic_filtering=True,id=e72fe350-d8b1-48d0-97a5-459536237a04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72fe350-d8') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_vif [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:fa:ad,bridge_name='br-int',has_traffic_filtering=True,id=e72fe350-d8b1-48d0-97a5-459536237a04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72fe350-d8') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape72fe350-d8, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:43 user nova-compute[71347]: INFO os_vif [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:fa:ad,bridge_name='br-int',has_traffic_filtering=True,id=e72fe350-d8b1-48d0-97a5-459536237a04,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape72fe350-d8')
Apr 14 14:54:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWqJOlEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:54:43 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[923a1b23-1ad7-4fec-9a47-81c276cc47a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:54:43 user nova-compute[71347]: No targets found.
Apr 14 14:54:43 user nova-compute[71347]: iSNS:
Apr 14 14:54:43 user nova-compute[71347]: No targets found.
Apr 14 14:54:43 user nova-compute[71347]: STATIC:
Apr 14 14:54:43 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066
Apr 14 14:54:43 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:54:43 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:54:43 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8
Apr 14 14:54:43 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:54:43 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:54:43 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 14:54:43 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:54:43 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:54:43 user nova-compute[71347]: FIRMWARE:
Apr 14 14:54:43 user nova-compute[71347]: No targets found.
Apr 14 14:54:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:54:43 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:54:43 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a5b00-83fd-448b-941d-b926f0bd0927]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc19b6-815a-42a4-a73d-3371cbef0990]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:54:43 user nova-compute[71347]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:54:43 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:54:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:54:43 user nova-compute[71347]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:54:43 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:54:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd8221900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b7d8c6-04ef-4c24-9d30-f28e7a9ee74a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[54314bb9-64cb-4280-9844-122e432fd4a7]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4ffc68-ed50-4b85-9f7f-43b4559d7eaa]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5604dcd-39e1-4079-979e-650c3f8506d9]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6b671e82-5daa2fd029e5e02b', '/dev/disk/by-id/scsi-23564616132666430', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6b671e82') {{(pid=82022) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94c9fed-c40b-4491-81fe-da0e116400c2]: (4, None) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37c3e8e-d00d-4415-a5be-8aca73755c2f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[97db7aee-02a5-4771-b9b9-9021ba0717b4]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260]
Apr 14 14:54:43 user nova-compute[71347]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260] successful.
Apr 14 14:54:43 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:54:43 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b35b7bb-abd7-4506-ab25-a033d96ca9a3]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== disconnect_volume: return (320ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:54:44 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Deleting instance files /opt/stack/data/nova/instances/bb195da3-b027-4af6-9c2e-cb8728368d6a_del
Apr 14 14:54:44 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Deletion of /opt/stack/data/nova/instances/bb195da3-b027-4af6-9c2e-cb8728368d6a_del complete
Apr 14 14:54:44 user nova-compute[71347]: INFO nova.compute.manager [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received event network-vif-unplugged-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Acquiring lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] No waiting events found dispatching network-vif-unplugged-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received event network-vif-unplugged-e72fe350-d8b1-48d0-97a5-459536237a04 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received event network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Acquiring lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] No waiting events found dispatching network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:54:44 user nova-compute[71347]: WARNING nova.compute.manager [req-5fe20735-bc93-4161-b8bb-d79810f17c94 req-11dc69b1-45e6-4037-8fb1-3d117516a311 service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received unexpected event network-vif-plugged-e72fe350-d8b1-48d0-97a5-459536237a04 for instance with vm_state active and task_state deleting.
Apr 14 14:54:45 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:54:45 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Took 0.97 seconds to deallocate network for instance.
Apr 14 14:54:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-7335f8f1-9c2e-41df-adf8-26205b16f00d req-d76b300b-5d67-43ae-a773-4dacb5d53d3c service nova] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Received event network-vif-deleted-e72fe350-d8b1-48d0-97a5-459536237a04 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:54:45 user nova-compute[71347]: INFO nova.compute.manager [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 14:54:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:54:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:54:46 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:54:46 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:54:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:46 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Deleted allocations for instance bb195da3-b027-4af6-9c2e-cb8728368d6a
Apr 14 14:54:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-c8b55885-7d9a-4df3-9e24-f5661337595c tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "bb195da3-b027-4af6-9c2e-cb8728368d6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.355s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:54:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:54:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:54:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:54:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:54:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:54:58 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681484083.643181, bb195da3-b027-4af6-9c2e-cb8728368d6a => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:54:58 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] VM Stopped (Lifecycle Event)
Apr 14 14:54:58 user nova-compute[71347]: DEBUG nova.compute.manager [None req-91d2f386-6a01-4107-b4db-4a59767e0745 None None] [instance: bb195da3-b027-4af6-9c2e-cb8728368d6a] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:54:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:55:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:55:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:55:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:55:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:55:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:55:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:55:22 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:55:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:25 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:25 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:25 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:55:26 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:55:26 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:55:26 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8558MB free_disk=26.226463317871094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e8325185-b8d9-410c-9da5-2ec5ee09620b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:55:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Updating instance_info_cache with network_info: [{"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:55:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:31 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:33 user nova-compute[71347]: INFO nova.compute.manager [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Rescuing
Apr 14 14:55:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquired lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG nova.network.neutron [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Updating instance_info_cache with network_info: [{"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Releasing lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG nova.compute.manager [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:33 user nova-compute[71347]: WARNING nova.compute.manager [req-44ec2607-3a3b-4259-b885-8f2a0aeae780 req-8b28b260-af7d-48b8-a2e0-26d6575385b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state rescuing.
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:34 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance destroyed successfully.
Apr 14 14:55:34 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Attempting a stable device rescue
Apr 14 14:55:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71347) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance directory exists: not creating {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 14:55:34 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Creating image(s)
Apr 14 14:55:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "/opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "/opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'trusted_certs' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "048f643298c7cdbfdf528e597808c41174d127bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "048f643298c7cdbfdf528e597808c41174d127bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:55:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf.part --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:35 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:35 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:55:35 user nova-compute[71347]: INFO nova.compute.claims [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Claim successful on node user
Apr 14 14:55:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf.part --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:35 user nova-compute[71347]: DEBUG nova.virt.images [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] 5b13b293-128b-466a-956d-60c9a34863d9 was qcow2, converting to raw {{(pid=71347) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 14:55:35 user nova-compute[71347]: DEBUG nova.privsep.utils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71347) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 14:55:35 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf.part /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf.converted {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:36 user nova-compute[71347]: WARNING nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state rescuing.
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:36 user nova-compute[71347]: WARNING nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state rescuing.
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:36 user nova-compute[71347]: WARNING nova.compute.manager [req-ab698313-5510-4b41-bae1-50001a72279e req-55d256ff-81a2-435a-8e03-c313ab8a631d service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state rescuing.
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf.part /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf.converted" returned: 0 in 0.576s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf.converted --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.network.neutron [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:55:36 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:55:36 user nova-compute[71347]: INFO nova.virt.block_device [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Booting with volume c0e09208-c40e-4eee-b7e7-bd45c326e066 at /dev/vda
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.policy [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "048f643298c7cdbfdf528e597808c41174d127bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.094s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "048f643298c7cdbfdf528e597808c41174d127bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "048f643298c7cdbfdf528e597808c41174d127bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG os_brick.utils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70451e2-2ce2-4470-810a-1cb8c3b0543f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1187552e-9e90-4358-94f5-e6f5b5753cbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac774bb-eaa0-4f9a-b545-a2295b5737bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0ed740-9859-4212-b02d-33716cb58d4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf --force-share --output=json" returned: 0 in 0.173s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf,backing_fmt=raw /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.rescue {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:55:36 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2cdfd0-ee7a-4e73-96a0-f7f52e7bd5f0]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG os_brick.utils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updating existing volume attachment record: eca3f057-0371-4bd3-aebd-68500c8ec8a7 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/048f643298c7cdbfdf528e597808c41174d127bf,backing_fmt=raw /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.rescue" returned: 0 in 0.065s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "048f643298c7cdbfdf528e597808c41174d127bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'migration_context' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Created local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Start _get_guest_xml network_info=[{"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "vif_mac": "fa:16:3e:e5:8a:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5b13b293-128b-466a-956d-60c9a34863d9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUSLrGXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e8325185-b8d9-410c-9da5-2ec5ee09620b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1126918-c0e8-4d10-9e16-96e368a479c8', 'serial': 'c1126918-c0e8-4d10-9e16-96e368a479c8'}, 'attachment_id': '88ef4c0b-49c3-46a3-afbf-50829a21b224', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'resources' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'numa_topology' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:55:36 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:55:36 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T14:13:16Z,direct_url=<?>,disk_format='qcow2',id=79416463-b265-4588-8d03-bcb84f0ecc83,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='8972b062c37142438150f11e483d6a85',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T14:13:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:55:36 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'vcpu_model' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUSLrGXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:55:37 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:55:37 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:55:37 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7193e9-57b4-4664-92b7-b1085fc7440b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PUSLrGXn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 14:55:37 user nova-compute[71347]: node.name = iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8
Apr 14 14:55:37 user nova-compute[71347]: node.tpgt = -1
Apr 14 14:55:37 user nova-compute[71347]: node.startup = automatic
Apr 14 14:55:37 user nova-compute[71347]: node.leading_login = No
Apr 14 14:55:37 user nova-compute[71347]: iface.iscsi_ifacename = default
Apr 14 14:55:37 user nova-compute[71347]: iface.net_ifacename = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.ipaddress = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.prefix_len = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.hwaddress = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.transport_name = tcp
Apr 14 14:55:37 user nova-compute[71347]: iface.initiatorname = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.state = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.vlan_id = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.vlan_priority = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.vlan_state = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.iface_num = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.mtu = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.port = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.bootproto = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.subnet_mask = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.gateway = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.dhcp_alt_client_id = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.dhcp_dns = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.dhcp_learn_iqn = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.dhcp_vendor_id_state = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.dhcp_vendor_id = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.dhcp_slp_da = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.fragmentation = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.gratuitous_arp = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.incoming_forwarding = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.tos_state = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.tos = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.ttl = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.delayed_ack = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.tcp_nagle = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.tcp_wsf_state = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.tcp_wsf = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.tcp_timer_scale = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.tcp_timestamp = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.redirect = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.def_task_mgmt_timeout = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.header_digest = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.data_digest = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.immediate_data = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.initial_r2t = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.data_seq_inorder = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.data_pdu_inorder = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.erl = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.max_receive_data_len = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.first_burst_len = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.max_outstanding_r2t = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.max_burst_len = 0
Apr 14 14:55:37 user nova-compute[71347]: iface.chap_auth = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.bidi_chap = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.strict_login_compliance = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.discovery_auth = <empty>
Apr 14 14:55:37 user nova-compute[71347]: iface.discovery_logout = <empty>
Apr 14 14:55:37 user nova-compute[71347]: node.discovery_address = <empty>
Apr 14 14:55:37 user nova-compute[71347]: node.discovery_port = 0
Apr 14 14:55:37 user nova-compute[71347]: node.discovery_type = static
Apr 14 14:55:37 user nova-compute[71347]: node.session.initial_cmdsn = 0
Apr 14 14:55:37 user nova-compute[71347]: node.session.initial_login_retry_max = 8
Apr 14 14:55:37 user nova-compute[71347]: node.session.xmit_thread_priority = -20
Apr 14 14:55:37 user nova-compute[71347]: node.session.cmds_max = 128
Apr 14 14:55:37 user nova-compute[71347]: node.session.queue_depth = 32
Apr 14 14:55:37 user nova-compute[71347]: node.session.nr_sessions = 1
Apr 14 14:55:37 user nova-compute[71347]: node.session.auth.authmethod = CHAP
Apr 14 14:55:37 user nova-compute[71347]: node.session.auth.username = PUSLrGXn
Apr 14 14:55:37 user nova-compute[71347]: node.session.auth.password = ***
Apr 14 14:55:37 user nova-compute[71347]: node.session.auth.username_in = <empty>
Apr 14 14:55:37 user nova-compute[71347]: node.session.auth.password_in = <empty>
Apr 14 14:55:37 user nova-compute[71347]: node.session.auth.chap_algs = MD5
Apr 14 14:55:37 user nova-compute[71347]: node.session.timeo.replacement_timeout = 120
Apr 14 14:55:37 user nova-compute[71347]: node.session.err_timeo.abort_timeout = 15
Apr 14 14:55:37 user nova-compute[71347]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 14:55:37 user nova-compute[71347]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 14:55:37 user nova-compute[71347]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.FastAbort = Yes
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.InitialR2T = No
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.ImmediateData = Yes
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.MaxConnections = 1
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 14:55:37 user nova-compute[71347]: node.session.iscsi.ERL = 0
Apr 14 14:55:37 user nova-compute[71347]: node.session.scan = manual
Apr 14 14:55:37 user nova-compute[71347]: node.session.reopen_max = 0
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].address = 172.16.0.220
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].port = 3260
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].startup = manual
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].tcp.window_size = 524288
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].tcp.type_of_service = 0
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].timeo.logout_timeout = 15
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].timeo.login_timeout = 15
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].timeo.auth_timeout = 45
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].iscsi.DataDigest = None
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].iscsi.IFMarker = No
Apr 14 14:55:37 user nova-compute[71347]: node.conn[0].iscsi.OFMarker = No
Apr 14 14:55:37 user nova-compute[71347]: # END RECORD
Apr 14 14:55:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd27de2-c4f3-46b8-9b67-3236bc2f7f3f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0ae4de-a833-4dcd-b33f-0b5f18e618c9]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUSLrGXn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUSLrGXn" returned: 0 in 0.028s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0ef662-c65a-4749-94dc-0eb44d9daaf2]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUSLrGXn'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a0df9-ef9d-416c-9a21-c739a49b6c4e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29b8686-bb84-469e-bf2c-f49e48fe730d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:55:37 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:55:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:55:37 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:55:37 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.183s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] HCTL ('35', '0', '0', 0) found on session 52 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec5d67b-bdc7-423a-8d5c-a6669bcea4a5]: (4, ('0 0 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Searching for a device in session 52 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUSLrGXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.213s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] <== connect_volume: return (215ms) {'type': 'block', 'scsi_wwn': '23664623830336632', 'path': '/dev/sdd'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664623830336632', 'path': '/dev/sdd'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469413864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469413864',id=45,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-tu6wx54m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:53:58Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=e8325185-b8d9-410c-9da5-2ec5ee09620b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "vif_mac": "fa:16:3e:e5:8a:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "vif_mac": "fa:16:3e:e5:8a:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=0e83d513-46c5-48cd-bcbe-9ae926f887a2,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e83d513-46') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.objects.instance [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'pci_devices' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:55:37 user nova-compute[71347]:   <uuid>e8325185-b8d9-410c-9da5-2ec5ee09620b</uuid>
Apr 14 14:55:37 user nova-compute[71347]:   <name>instance-0000002d</name>
Apr 14 14:55:37 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:55:37 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:55:37 user nova-compute[71347]:   <metadata>
Apr 14 14:55:37 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:55:37 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:55:37 user nova-compute[71347]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1469413864</nova:name>
Apr 14 14:55:37 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:55:36</nova:creationTime>
Apr 14 14:55:37 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:55:37 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:55:37 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:55:37 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:55:37 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:55:37 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:55:37 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:55:37 user nova-compute[71347]:       <nova:owner>
Apr 14 14:55:37 user nova-compute[71347]:         <nova:user uuid="2e321f85d3d44c2baf210a1962f4f08f">tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member</nova:user>
Apr 14 14:55:37 user nova-compute[71347]:         <nova:project uuid="2241300ad3704734aed3990cc7aadc1b">tempest-ServerBootFromVolumeStableRescueTest-2086147649</nova:project>
Apr 14 14:55:37 user nova-compute[71347]:       </nova:owner>
Apr 14 14:55:37 user nova-compute[71347]:       <nova:root type="image" uuid="79416463-b265-4588-8d03-bcb84f0ecc83"/>
Apr 14 14:55:37 user nova-compute[71347]:       <nova:ports>
Apr 14 14:55:37 user nova-compute[71347]:         <nova:port uuid="0e83d513-46c5-48cd-bcbe-9ae926f887a2">
Apr 14 14:55:37 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 14:55:37 user nova-compute[71347]:         </nova:port>
Apr 14 14:55:37 user nova-compute[71347]:       </nova:ports>
Apr 14 14:55:37 user nova-compute[71347]:     </nova:instance>
Apr 14 14:55:37 user nova-compute[71347]:   </metadata>
Apr 14 14:55:37 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:55:37 user nova-compute[71347]:     <system>
Apr 14 14:55:37 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:55:37 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:55:37 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:55:37 user nova-compute[71347]:       <entry name="serial">e8325185-b8d9-410c-9da5-2ec5ee09620b</entry>
Apr 14 14:55:37 user nova-compute[71347]:       <entry name="uuid">e8325185-b8d9-410c-9da5-2ec5ee09620b</entry>
Apr 14 14:55:37 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:55:37 user nova-compute[71347]:     </system>
Apr 14 14:55:37 user nova-compute[71347]:   </sysinfo>
Apr 14 14:55:37 user nova-compute[71347]:   <os>
Apr 14 14:55:37 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:55:37 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:55:37 user nova-compute[71347]:   </os>
Apr 14 14:55:37 user nova-compute[71347]:   <features>
Apr 14 14:55:37 user nova-compute[71347]:     <acpi/>
Apr 14 14:55:37 user nova-compute[71347]:     <apic/>
Apr 14 14:55:37 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:55:37 user nova-compute[71347]:   </features>
Apr 14 14:55:37 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:55:37 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:55:37 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:55:37 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:55:37 user nova-compute[71347]:   </clock>
Apr 14 14:55:37 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:55:37 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:55:37 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:55:37 user nova-compute[71347]:   </cpu>
Apr 14 14:55:37 user nova-compute[71347]:   <devices>
Apr 14 14:55:37 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:55:37 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:55:37 user nova-compute[71347]:       <source dev="/dev/sdd"/>
Apr 14 14:55:37 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:55:37 user nova-compute[71347]:       <serial>c1126918-c0e8-4d10-9e16-96e368a479c8</serial>
Apr 14 14:55:37 user nova-compute[71347]:     </disk>
Apr 14 14:55:37 user nova-compute[71347]:     <disk type="file" device="disk">
Apr 14 14:55:37 user nova-compute[71347]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 14:55:37 user nova-compute[71347]:       <source file="/opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.rescue"/>
Apr 14 14:55:37 user nova-compute[71347]:       <target dev="vdb" bus="virtio"/>
Apr 14 14:55:37 user nova-compute[71347]:       <boot order="1"/>
Apr 14 14:55:37 user nova-compute[71347]:     </disk>
Apr 14 14:55:37 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:55:37 user nova-compute[71347]:       <mac address="fa:16:3e:e5:8a:da"/>
Apr 14 14:55:37 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:55:37 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:55:37 user nova-compute[71347]:       <target dev="tap0e83d513-46"/>
Apr 14 14:55:37 user nova-compute[71347]:     </interface>
Apr 14 14:55:37 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:55:37 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/console.log" append="off"/>
Apr 14 14:55:37 user nova-compute[71347]:     </serial>
Apr 14 14:55:37 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:55:37 user nova-compute[71347]:     <video>
Apr 14 14:55:37 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:55:37 user nova-compute[71347]:     </video>
Apr 14 14:55:37 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:55:37 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:55:37 user nova-compute[71347]:     </rng>
Apr 14 14:55:37 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:55:37 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:55:37 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:55:37 user nova-compute[71347]:     </memballoon>
Apr 14 14:55:37 user nova-compute[71347]:   </devices>
Apr 14 14:55:37 user nova-compute[71347]: </domain>
Apr 14 14:55:37 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:55:37 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance destroyed successfully.
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] No VIF found with MAC fa:16:3e:e5:8a:da, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Successfully created port: 7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:37 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:38 user nova-compute[71347]: WARNING nova.compute.manager [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state rescuing.
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:38 user nova-compute[71347]: WARNING nova.compute.manager [req-758938a2-a2ad-43f1-bf75-dde2a14ab4cb req-3997364b-b3fe-4db4-83f8-e191970ed1b9 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state rescuing.
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Successfully updated port: 7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquired lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-changed-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Refreshing instance network info cache due to event network-changed-7f1eaba2-b235-4c56-bc36-cf1821bf51b4. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] Acquiring lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updating instance_info_cache with network_info: [{"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Releasing lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Instance network_info: |[{"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] Acquired lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Refreshing network info cache for port 7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updated VIF entry in instance network info cache for port 7f1eaba2-b235-4c56-bc36-cf1821bf51b4. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:55:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updating instance_info_cache with network_info: [{"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:55:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-938608e6-17ad-40a4-ab9d-a180e307045a req-41287a40-9521-4d9d-a6fd-6d8754755fff service nova] Releasing lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:40 user nova-compute[71347]: WARNING nova.compute.manager [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state rescuing.
Apr 14 14:55:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG nova.compute.manager [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:40 user nova-compute[71347]: WARNING nova.compute.manager [req-b9079089-37e2-4531-aa86-327ca2d95e65 req-797c737f-5aa2-4cf2-973a-8d5c52b838fa service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state rescuing.
Apr 14 14:55:40 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for e8325185-b8d9-410c-9da5-2ec5ee09620b due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:55:40 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484140.9933798, e8325185-b8d9-410c-9da5-2ec5ee09620b => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:55:40 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] VM Resumed (Lifecycle Event)
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-2277e665-7251-4954-bbf2-e598c7b653dd tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:55:41 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484140.9949994, e8325185-b8d9-410c-9da5-2ec5ee09620b => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:55:41 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] VM Started (Lifecycle Event)
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:55:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Creating image(s)
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Ensure instance console log exists: /opt/stack/data/nova/instances/48b4950e-98c1-41b1-b578-7c2d2ddddc3d/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Start _get_guest_xml network_info=[{"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWqJOlEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48b4950e-98c1-41b1-b578-7c2d2ddddc3d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0e09208-c40e-4eee-b7e7-bd45c326e066', 'serial': 'c0e09208-c40e-4eee-b7e7-bd45c326e066'}, 'attachment_id': 'eca3f057-0371-4bd3-aebd-68500c8ec8a7', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:55:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:55:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWqJOlEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:55:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:55:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:55:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:55:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:55:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:55:41 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:55:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1b636f-f17e-49e5-a948-6679800f2f69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:55:42 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfa2b73-b881-4c93-979b-7cc82bbb83bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066] added
Apr 14 14:55:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01ac204-ce17-4f20-b002-a4e1f8b0c44f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39b850-1287-4c61-86ae-4472fbd80816]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWqJOlEw {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWqJOlEw" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44f6333-5656-4148-8d7e-8cb0f635d24e]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DWqJOlEw'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[2686918d-425d-4e60-9f47-42f423bb2e2d]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc7c10-aec6-47e5-8291-b4c660e50fe8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:55:42 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:55:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:55:42 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:55:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca4881e-b8b1-4290-ac2c-8ee74981204d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260]
Apr 14 14:55:42 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260] successful.
Apr 14 14:55:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[63de1508-18c1-478d-a069-a7ff83d5c184]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d1fa3d-27ea-46ba-ab94-e6c241940971]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:55:42 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:55:42 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:55:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:55:42 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:55:42 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:55:42 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[226ed559-262b-4b6f-b8e7-876d057d3f30]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:55:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWqJOlEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23564616132666430', 'path': '/dev/sdb'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564616132666430', 'path': '/dev/sdb'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-585640922',display_name='tempest-TestVolumeBootPattern-server-585640922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-585640922',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-c3662wia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:55:37Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=48b4950e-98c1-41b1-b578-7c2d2ddddc3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=7f1eaba2-b235-4c56-bc36-cf1821bf51b4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1eaba2-b2') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.objects.instance [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'pci_devices' on Instance uuid 48b4950e-98c1-41b1-b578-7c2d2ddddc3d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:55:43 user nova-compute[71347]:   <uuid>48b4950e-98c1-41b1-b578-7c2d2ddddc3d</uuid>
Apr 14 14:55:43 user nova-compute[71347]:   <name>instance-0000002e</name>
Apr 14 14:55:43 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:55:43 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:55:43 user nova-compute[71347]:   <metadata>
Apr 14 14:55:43 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:55:43 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:55:43 user nova-compute[71347]:       <nova:name>tempest-TestVolumeBootPattern-server-585640922</nova:name>
Apr 14 14:55:43 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:55:41</nova:creationTime>
Apr 14 14:55:43 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:55:43 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:55:43 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:55:43 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:55:43 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:55:43 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:55:43 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:55:43 user nova-compute[71347]:       <nova:owner>
Apr 14 14:55:43 user nova-compute[71347]:         <nova:user uuid="43b5d8526a7c4b0fb5f15a8345b229e2">tempest-TestVolumeBootPattern-152189831-project-member</nova:user>
Apr 14 14:55:43 user nova-compute[71347]:         <nova:project uuid="e217ba6818e94879aa02015ccf21b058">tempest-TestVolumeBootPattern-152189831</nova:project>
Apr 14 14:55:43 user nova-compute[71347]:       </nova:owner>
Apr 14 14:55:43 user nova-compute[71347]:       <nova:ports>
Apr 14 14:55:43 user nova-compute[71347]:         <nova:port uuid="7f1eaba2-b235-4c56-bc36-cf1821bf51b4">
Apr 14 14:55:43 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 14:55:43 user nova-compute[71347]:         </nova:port>
Apr 14 14:55:43 user nova-compute[71347]:       </nova:ports>
Apr 14 14:55:43 user nova-compute[71347]:     </nova:instance>
Apr 14 14:55:43 user nova-compute[71347]:   </metadata>
Apr 14 14:55:43 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:55:43 user nova-compute[71347]:     <system>
Apr 14 14:55:43 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:55:43 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:55:43 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:55:43 user nova-compute[71347]:       <entry name="serial">48b4950e-98c1-41b1-b578-7c2d2ddddc3d</entry>
Apr 14 14:55:43 user nova-compute[71347]:       <entry name="uuid">48b4950e-98c1-41b1-b578-7c2d2ddddc3d</entry>
Apr 14 14:55:43 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:55:43 user nova-compute[71347]:     </system>
Apr 14 14:55:43 user nova-compute[71347]:   </sysinfo>
Apr 14 14:55:43 user nova-compute[71347]:   <os>
Apr 14 14:55:43 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:55:43 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:55:43 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:55:43 user nova-compute[71347]:   </os>
Apr 14 14:55:43 user nova-compute[71347]:   <features>
Apr 14 14:55:43 user nova-compute[71347]:     <acpi/>
Apr 14 14:55:43 user nova-compute[71347]:     <apic/>
Apr 14 14:55:43 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:55:43 user nova-compute[71347]:   </features>
Apr 14 14:55:43 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:55:43 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:55:43 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:55:43 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:55:43 user nova-compute[71347]:   </clock>
Apr 14 14:55:43 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:55:43 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:55:43 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:55:43 user nova-compute[71347]:   </cpu>
Apr 14 14:55:43 user nova-compute[71347]:   <devices>
Apr 14 14:55:43 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:55:43 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:55:43 user nova-compute[71347]:       <source dev="/dev/sdb"/>
Apr 14 14:55:43 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:55:43 user nova-compute[71347]:       <serial>c0e09208-c40e-4eee-b7e7-bd45c326e066</serial>
Apr 14 14:55:43 user nova-compute[71347]:     </disk>
Apr 14 14:55:43 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:55:43 user nova-compute[71347]:       <mac address="fa:16:3e:07:6f:96"/>
Apr 14 14:55:43 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:55:43 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:55:43 user nova-compute[71347]:       <target dev="tap7f1eaba2-b2"/>
Apr 14 14:55:43 user nova-compute[71347]:     </interface>
Apr 14 14:55:43 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:55:43 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/48b4950e-98c1-41b1-b578-7c2d2ddddc3d/console.log" append="off"/>
Apr 14 14:55:43 user nova-compute[71347]:     </serial>
Apr 14 14:55:43 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:55:43 user nova-compute[71347]:     <video>
Apr 14 14:55:43 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:55:43 user nova-compute[71347]:     </video>
Apr 14 14:55:43 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:55:43 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:55:43 user nova-compute[71347]:     </rng>
Apr 14 14:55:43 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:55:43 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:55:43 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:55:43 user nova-compute[71347]:     </memballoon>
Apr 14 14:55:43 user nova-compute[71347]:   </devices>
Apr 14 14:55:43 user nova-compute[71347]: </domain>
Apr 14 14:55:43 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-585640922',display_name='tempest-TestVolumeBootPattern-server-585640922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-585640922',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-c3662wia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:55:37Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=48b4950e-98c1-41b1-b578-7c2d2ddddc3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=7f1eaba2-b235-4c56-bc36-cf1821bf51b4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1eaba2-b2') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG os_vif [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=7f1eaba2-b235-4c56-bc36-cf1821bf51b4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1eaba2-b2') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f1eaba2-b2, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f1eaba2-b2, col_values=(('external_ids', {'iface-id': '7f1eaba2-b235-4c56-bc36-cf1821bf51b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:6f:96', 'vm-uuid': '48b4950e-98c1-41b1-b578-7c2d2ddddc3d'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:43 user nova-compute[71347]: INFO os_vif [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=7f1eaba2-b235-4c56-bc36-cf1821bf51b4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1eaba2-b2')
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No VIF found with MAC fa:16:3e:07:6f:96, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:55:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] Acquiring lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:45 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:45 user nova-compute[71347]: DEBUG nova.compute.manager [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] No waiting events found dispatching network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:45 user nova-compute[71347]: WARNING nova.compute.manager [req-b4748f21-7b20-4872-b649-7b778b05ed72 req-bb38ec4c-e588-4cde-9c8c-0ab92c27b6cb service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received unexpected event network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance with vm_state building and task_state spawning.
Apr 14 14:55:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:45 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:46 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484146.9755204, 48b4950e-98c1-41b1-b578-7c2d2ddddc3d => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:55:46 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] VM Resumed (Lifecycle Event)
Apr 14 14:55:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:55:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:55:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Instance spawned successfully.
Apr 14 14:55:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:55:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:55:47 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484146.9778008, 48b4950e-98c1-41b1-b578-7c2d2ddddc3d => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:55:47 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] VM Started (Lifecycle Event)
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:55:47 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:55:47 user nova-compute[71347]: INFO nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] Acquiring lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] No waiting events found dispatching network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:55:47 user nova-compute[71347]: WARNING nova.compute.manager [req-20fa73a3-a27c-4b1f-8891-2bb42f007fec req-81b77985-a670-4fc4-8c6f-289349e13cf0 service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received unexpected event network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance with vm_state building and task_state spawning.
Apr 14 14:55:47 user nova-compute[71347]: INFO nova.compute.manager [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Took 11.46 seconds to build instance.
Apr 14 14:55:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-56cd5950-36ed-4ff3-b4ec-b35ed62b628b tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.594s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:55:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:55:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:56:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:56:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:56:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:56:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:23 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:56:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:56:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:56:26 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.rescue --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:56:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:56:28 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:56:28 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=26.154685974121094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e8325185-b8d9-410c-9da5-2ec5ee09620b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:56:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:56:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:56:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 14:56:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:34 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:37 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:39 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:39 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:56:39 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:56:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:56:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:56:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:56:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:56:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:56:43 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:48 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:53 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:56:58 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:57:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:57:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:57:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:57:03 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:08 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:13 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:18 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:57:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:57:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:57:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:57:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:57:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:57:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:24 user nova-compute[71347]: INFO nova.compute.manager [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Unrescuing
Apr 14 14:57:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquired lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG nova.network.neutron [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG nova.network.neutron [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Updating instance_info_cache with network_info: [{"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Releasing lock "refresh_cache-e8325185-b8d9-410c-9da5-2ec5ee09620b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG nova.objects.instance [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'flavor' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG nova.compute.manager [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:57:24 user nova-compute[71347]: WARNING nova.compute.manager [req-48eebbba-6c4b-4e6a-bb38-61e0f9f71367 req-ad649202-87a3-484f-b6ec-6a9db9d0591a service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:57:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:24 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:25 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance destroyed successfully.
Apr 14 14:57:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-changed-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Refreshing instance network info cache due to event network-changed-7f1eaba2-b235-4c56-bc36-cf1821bf51b4. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] Acquiring lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] Acquired lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Refreshing network info cache for port 7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updated VIF entry in instance network info cache for port 7f1eaba2-b235-4c56-bc36-cf1821bf51b4. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updating instance_info_cache with network_info: [{"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-c3f13b4d-5fb9-4bd5-9db1-3369472f64c5 req-0f2debe9-4af7-49e3-b7d7-e18f66e6638b service nova] Releasing lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:57:26 user nova-compute[71347]: WARNING nova.compute.manager [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:57:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:57:27 user nova-compute[71347]: WARNING nova.compute.manager [req-5dff3584-7143-4f39-9b66-08900b2f7246 req-0aa4bd29-706c-498a-9d35-dddbb5bcfaae service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state rescued and task_state unrescuing.
Apr 14 14:57:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:57:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 14:57:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:57:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:57:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:57:27 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.virt.libvirt.host [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Removed pending event for e8325185-b8d9-410c-9da5-2ec5ee09620b due to event {{(pid=71347) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484248.9477556, e8325185-b8d9-410c-9da5-2ec5ee09620b => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:57:28 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] VM Resumed (Lifecycle Event)
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-1f55b321-e0df-44b7-98c0-8c4bfe414552 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:57:28 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 14:57:28 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484248.9483976, e8325185-b8d9-410c-9da5-2ec5ee09620b => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:57:28 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] VM Started (Lifecycle Event)
Apr 14 14:57:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:57:29 user nova-compute[71347]: WARNING nova.compute.manager [req-6a5ed8d4-78a0-43bf-a9ec-58989563d30c req-2a4cb7f5-1578-43b4-981a-28cbd6553ad7 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state None.
Apr 14 14:57:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:57:30 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:57:30 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8520MB free_disk=26.153423309326172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e8325185-b8d9-410c-9da5-2ec5ee09620b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:57:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:33 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "b381b0d5-3e84-422a-90d7-154041818f09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "b381b0d5-3e84-422a-90d7-154041818f09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Starting instance... {{(pid=71347) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 14:57:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:35 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71347) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 14:57:35 user nova-compute[71347]: INFO nova.compute.claims [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Claim successful on node user
Apr 14 14:57:35 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:57:35 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Start building networks asynchronously for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Allocating IP information in the background. {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] allocate_for_instance() {{(pid=71347) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 14:57:36 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 14:57:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Start building block device mappings for instance. {{(pid=71347) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 14:57:36 user nova-compute[71347]: INFO nova.virt.block_device [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Booting with volume 813cbaf0-f5d6-4da5-9c67-816f8c1e417d at /dev/vda
Apr 14 14:57:36 user nova-compute[71347]: DEBUG nova.policy [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43b5d8526a7c4b0fb5f15a8345b229e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e217ba6818e94879aa02015ccf21b058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71347) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG os_brick.utils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cfb8c3-6127-4004-962d-ed429b81376c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bf84e89a9ad2\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1390529-537f-4cb2-b456-0767e77ad5e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3396747e-5b20-4d82-b446-d0a7bb16c8c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c86adf-aed8-4677-871c-023ad08dd817]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Running cmd (subprocess): nvme version {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] 'nvme version' failed. Not Retrying. {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] nvme not present on system {{(pid=71347) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 14:57:36 user nova-compute[71347]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a036dd-cc03-4a24-852e-a28f793cb114]: (4, '') {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71347) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.lightos [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] LIGHTOS: no hostnqn found. {{(pid=71347) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG os_brick.utils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bf84e89a9ad2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG nova.virt.block_device [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updating existing volume attachment record: e2439eae-89a3-450e-b9a4-42b0967cdb69 {{(pid=71347) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 14:57:36 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:37 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Successfully created port: fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Successfully updated port: fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquired lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Building network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-changed-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG nova.compute.manager [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Refreshing instance network info cache due to event network-changed-fa812b04-be77-4793-92ba-dd4550d6a682. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] Acquiring lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Instance cache missing network info. {{(pid=71347) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG nova.network.neutron [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updating instance_info_cache with network_info: [{"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Releasing lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Instance network_info: |[{"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71347) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] Acquired lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:57:38 user nova-compute[71347]: DEBUG nova.network.neutron [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Refreshing network info cache for port fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:57:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updated VIF entry in instance network info cache for port fa812b04-be77-4793-92ba-dd4550d6a682. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:57:39 user nova-compute[71347]: DEBUG nova.network.neutron [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updating instance_info_cache with network_info: [{"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:57:39 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6790c2e9-7236-426e-8dff-b8171cc56b83 req-dfa52556-d287-4a35-8f24-e8b31d442bdc service nova] Releasing lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:57:39 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:40 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Start spawning the instance on the hypervisor. {{(pid=71347) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Creating instance directory {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 14:57:41 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Creating image(s)
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Did not create local disks {{(pid=71347) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Ensure instance console log exists: /opt/stack/data/nova/instances/b381b0d5-3e84-422a-90d7-154041818f09/console.log {{(pid=71347) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Start _get_guest_xml network_info=[{"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoBTRxAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b381b0d5-3e84-422a-90d7-154041818f09', 'attached_at': '', 'detached_at': '', 'volume_id': '813cbaf0-f5d6-4da5-9c67-816f8c1e417d', 'serial': '813cbaf0-f5d6-4da5-9c67-816f8c1e417d'}, 'attachment_id': 'e2439eae-89a3-450e-b9a4-42b0967cdb69', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 14:57:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:57:41 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71347) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T14:14:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image limits 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flavor pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Image pref 0:0:0 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71347) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Got 1 possible topologies {{(pid=71347) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.hardware [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71347) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Calling os-brick to attach iSCSI Volume {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoBTRxAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:57:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:57:41 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:57:41 user nova-compute[71347]: INFO os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c458c3d1-dcaa-47c1-b153-4d5eb6c661d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 14:57:41 user nova-compute[71347]:  {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --interface default --op new {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc349064-7fde-410e-975d-f7451c19ce04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d] added\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d] added
Apr 14 14:57:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[06034b1f-5a05-412b-b7d8-bcf45c975e69]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bac735-9b4c-4f7e-af4d-140f3d926788]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DoBTRxAV {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DoBTRxAV" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a53c7b7-39df-4109-a7d8-9bbb2ae2f9bc]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DoBTRxAV'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc80f0e-df55-4742-b087-4317e842216f]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[948bc594-a0c0-4a60-a6da-81714325f22b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:57:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:57:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --login {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[303dc6bf-c86a-44ff-8832-54c16b2315fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d, portal: 172.16.0.220,3260]
Apr 14 14:57:41 user nova-compute[71347]: Login to [iface: default, target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d, portal: 172.16.0.220,3260] successful.
Apr 14 14:57:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[53427907-dc7d-484e-9bc6-fb1605600ef4]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dc459a-0a3b-49a7-8d12-a7626fd83250]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)
Apr 14 14:57:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:57:41 user nova-compute[71347]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)
Apr 14 14:57:41 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to 172.16.0.220:3260 {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=71347) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71347) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d63e28b-62d0-4024-aaf4-dc6226810926]: (4, ('- - 0', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: None {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:57:41 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71347) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoBTRxAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71347) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26263303362343065', 'path': '/dev/sde'} {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263303362343065', 'path': '/dev/sde'} {{(pid=71347) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-506145245',display_name='tempest-TestVolumeBootPattern-server-506145245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-506145245',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-s370tojs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:57:36Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=b381b0d5-3e84-422a-90d7-154041818f09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71347) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=fa812b04-be77-4793-92ba-dd4550d6a682,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa812b04-be') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.objects.instance [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'pci_devices' on Instance uuid b381b0d5-3e84-422a-90d7-154041818f09 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] End _get_guest_xml xml=<domain type="kvm">
Apr 14 14:57:42 user nova-compute[71347]:   <uuid>b381b0d5-3e84-422a-90d7-154041818f09</uuid>
Apr 14 14:57:42 user nova-compute[71347]:   <name>instance-0000002f</name>
Apr 14 14:57:42 user nova-compute[71347]:   <memory>131072</memory>
Apr 14 14:57:42 user nova-compute[71347]:   <vcpu>1</vcpu>
Apr 14 14:57:42 user nova-compute[71347]:   <metadata>
Apr 14 14:57:42 user nova-compute[71347]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 14:57:42 user nova-compute[71347]:       <nova:package version="0.0.0"/>
Apr 14 14:57:42 user nova-compute[71347]:       <nova:name>tempest-TestVolumeBootPattern-server-506145245</nova:name>
Apr 14 14:57:42 user nova-compute[71347]:       <nova:creationTime>2023-04-14 14:57:41</nova:creationTime>
Apr 14 14:57:42 user nova-compute[71347]:       <nova:flavor name="m1.nano">
Apr 14 14:57:42 user nova-compute[71347]:         <nova:memory>128</nova:memory>
Apr 14 14:57:42 user nova-compute[71347]:         <nova:disk>1</nova:disk>
Apr 14 14:57:42 user nova-compute[71347]:         <nova:swap>0</nova:swap>
Apr 14 14:57:42 user nova-compute[71347]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 14:57:42 user nova-compute[71347]:         <nova:vcpus>1</nova:vcpus>
Apr 14 14:57:42 user nova-compute[71347]:       </nova:flavor>
Apr 14 14:57:42 user nova-compute[71347]:       <nova:owner>
Apr 14 14:57:42 user nova-compute[71347]:         <nova:user uuid="43b5d8526a7c4b0fb5f15a8345b229e2">tempest-TestVolumeBootPattern-152189831-project-member</nova:user>
Apr 14 14:57:42 user nova-compute[71347]:         <nova:project uuid="e217ba6818e94879aa02015ccf21b058">tempest-TestVolumeBootPattern-152189831</nova:project>
Apr 14 14:57:42 user nova-compute[71347]:       </nova:owner>
Apr 14 14:57:42 user nova-compute[71347]:       <nova:ports>
Apr 14 14:57:42 user nova-compute[71347]:         <nova:port uuid="fa812b04-be77-4793-92ba-dd4550d6a682">
Apr 14 14:57:42 user nova-compute[71347]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 14:57:42 user nova-compute[71347]:         </nova:port>
Apr 14 14:57:42 user nova-compute[71347]:       </nova:ports>
Apr 14 14:57:42 user nova-compute[71347]:     </nova:instance>
Apr 14 14:57:42 user nova-compute[71347]:   </metadata>
Apr 14 14:57:42 user nova-compute[71347]:   <sysinfo type="smbios">
Apr 14 14:57:42 user nova-compute[71347]:     <system>
Apr 14 14:57:42 user nova-compute[71347]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 14:57:42 user nova-compute[71347]:       <entry name="product">OpenStack Nova</entry>
Apr 14 14:57:42 user nova-compute[71347]:       <entry name="version">0.0.0</entry>
Apr 14 14:57:42 user nova-compute[71347]:       <entry name="serial">b381b0d5-3e84-422a-90d7-154041818f09</entry>
Apr 14 14:57:42 user nova-compute[71347]:       <entry name="uuid">b381b0d5-3e84-422a-90d7-154041818f09</entry>
Apr 14 14:57:42 user nova-compute[71347]:       <entry name="family">Virtual Machine</entry>
Apr 14 14:57:42 user nova-compute[71347]:     </system>
Apr 14 14:57:42 user nova-compute[71347]:   </sysinfo>
Apr 14 14:57:42 user nova-compute[71347]:   <os>
Apr 14 14:57:42 user nova-compute[71347]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 14:57:42 user nova-compute[71347]:     <boot dev="hd"/>
Apr 14 14:57:42 user nova-compute[71347]:     <smbios mode="sysinfo"/>
Apr 14 14:57:42 user nova-compute[71347]:   </os>
Apr 14 14:57:42 user nova-compute[71347]:   <features>
Apr 14 14:57:42 user nova-compute[71347]:     <acpi/>
Apr 14 14:57:42 user nova-compute[71347]:     <apic/>
Apr 14 14:57:42 user nova-compute[71347]:     <vmcoreinfo/>
Apr 14 14:57:42 user nova-compute[71347]:   </features>
Apr 14 14:57:42 user nova-compute[71347]:   <clock offset="utc">
Apr 14 14:57:42 user nova-compute[71347]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 14:57:42 user nova-compute[71347]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 14:57:42 user nova-compute[71347]:     <timer name="hpet" present="no"/>
Apr 14 14:57:42 user nova-compute[71347]:   </clock>
Apr 14 14:57:42 user nova-compute[71347]:   <cpu mode="custom" match="exact">
Apr 14 14:57:42 user nova-compute[71347]:     <model>Nehalem</model>
Apr 14 14:57:42 user nova-compute[71347]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 14:57:42 user nova-compute[71347]:   </cpu>
Apr 14 14:57:42 user nova-compute[71347]:   <devices>
Apr 14 14:57:42 user nova-compute[71347]:     <disk type="block" device="disk">
Apr 14 14:57:42 user nova-compute[71347]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 14:57:42 user nova-compute[71347]:       <source dev="/dev/sde"/>
Apr 14 14:57:42 user nova-compute[71347]:       <target dev="vda" bus="virtio"/>
Apr 14 14:57:42 user nova-compute[71347]:       <serial>813cbaf0-f5d6-4da5-9c67-816f8c1e417d</serial>
Apr 14 14:57:42 user nova-compute[71347]:     </disk>
Apr 14 14:57:42 user nova-compute[71347]:     <interface type="ethernet">
Apr 14 14:57:42 user nova-compute[71347]:       <mac address="fa:16:3e:58:f1:b9"/>
Apr 14 14:57:42 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:57:42 user nova-compute[71347]:       <mtu size="1442"/>
Apr 14 14:57:42 user nova-compute[71347]:       <target dev="tapfa812b04-be"/>
Apr 14 14:57:42 user nova-compute[71347]:     </interface>
Apr 14 14:57:42 user nova-compute[71347]:     <serial type="pty">
Apr 14 14:57:42 user nova-compute[71347]:       <log file="/opt/stack/data/nova/instances/b381b0d5-3e84-422a-90d7-154041818f09/console.log" append="off"/>
Apr 14 14:57:42 user nova-compute[71347]:     </serial>
Apr 14 14:57:42 user nova-compute[71347]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 14:57:42 user nova-compute[71347]:     <video>
Apr 14 14:57:42 user nova-compute[71347]:       <model type="virtio"/>
Apr 14 14:57:42 user nova-compute[71347]:     </video>
Apr 14 14:57:42 user nova-compute[71347]:     <rng model="virtio">
Apr 14 14:57:42 user nova-compute[71347]:       <backend model="random">/dev/urandom</backend>
Apr 14 14:57:42 user nova-compute[71347]:     </rng>
Apr 14 14:57:42 user nova-compute[71347]:     <controller type="usb" index="0" model="none"/>
Apr 14 14:57:42 user nova-compute[71347]:     <memballoon model="virtio">
Apr 14 14:57:42 user nova-compute[71347]:       <stats period="10"/>
Apr 14 14:57:42 user nova-compute[71347]:     </memballoon>
Apr 14 14:57:42 user nova-compute[71347]:   </devices>
Apr 14 14:57:42 user nova-compute[71347]: </domain>
Apr 14 14:57:42 user nova-compute[71347]:  {{(pid=71347) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-506145245',display_name='tempest-TestVolumeBootPattern-server-506145245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-506145245',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-s370tojs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T14:57:36Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=b381b0d5-3e84-422a-90d7-154041818f09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=fa812b04-be77-4793-92ba-dd4550d6a682,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa812b04-be') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG os_vif [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=fa812b04-be77-4793-92ba-dd4550d6a682,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa812b04-be') {{(pid=71347) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa812b04-be, may_exist=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa812b04-be, col_values=(('external_ids', {'iface-id': 'fa812b04-be77-4793-92ba-dd4550d6a682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:f1:b9', 'vm-uuid': 'b381b0d5-3e84-422a-90d7-154041818f09'}),)) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:42 user nova-compute[71347]: INFO os_vif [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=fa812b04-be77-4793-92ba-dd4550d6a682,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa812b04-be')
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No BDM found with device name vda, not building metadata. {{(pid=71347) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 14:57:42 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] No VIF found with MAC fa:16:3e:58:f1:b9, not building metadata {{(pid=71347) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] Acquiring lock "b381b0d5-3e84-422a-90d7-154041818f09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG nova.compute.manager [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] No waiting events found dispatching network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:57:44 user nova-compute[71347]: WARNING nova.compute.manager [req-02010c01-701d-489e-b94b-3b1fbe2dc71f req-041bfd66-8f1b-4936-9885-64ef9fb65d44 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received unexpected event network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 for instance with vm_state building and task_state spawning.
Apr 14 14:57:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] Acquiring lock "b381b0d5-3e84-422a-90d7-154041818f09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.compute.manager [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] No waiting events found dispatching network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:57:46 user nova-compute[71347]: WARNING nova.compute.manager [req-d636fb7b-729b-42fa-bde9-dde2d3108947 req-35edf689-1859-4f19-b70b-2a04c5e754cd service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received unexpected event network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 for instance with vm_state building and task_state spawning.
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484266.390215, b381b0d5-3e84-422a-90d7-154041818f09 => Resumed> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:57:46 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] VM Resumed (Lifecycle Event)
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Instance event wait completed in 0 seconds for  {{(pid=71347) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Guest created on hypervisor {{(pid=71347) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 14:57:46 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Instance spawned successfully.
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Found default for hw_cdrom_bus of ide {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Found default for hw_disk_bus of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Found default for hw_input_bus of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Found default for hw_pointer_model of None {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Found default for hw_video_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Found default for hw_vif_model of virtio {{(pid=71347) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 14:57:46 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.virt.driver [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] Emitting event <LifecycleEvent: 1681484266.3912878, b381b0d5-3e84-422a-90d7-154041818f09 => Started> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:57:46 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] VM Started (Lifecycle Event)
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71347) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 14:57:46 user nova-compute[71347]: INFO nova.compute.manager [None req-bf2f3580-c551-4118-95cf-e47a8519f610 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 14:57:46 user nova-compute[71347]: INFO nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 14 14:57:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:57:46 user nova-compute[71347]: INFO nova.compute.manager [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Took 10.96 seconds to build instance.
Apr 14 14:57:46 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-d5fdd92e-dd70-4b4c-b5e8-b41fd40236d3 tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "b381b0d5-3e84-422a-90d7-154041818f09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.131s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:57:46 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:57:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:57:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:57:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:58:14 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:19 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:24 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:58:27 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:27 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:58:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:58:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:58:27 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:58:28 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [{"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:58:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-43bcfbdd-5fc4-4c83-8d67-f660404766b2" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:58:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:58:30 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:58:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:58:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:58:30 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:58:31 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:58:32 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:58:32 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=26.15161895751953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance e8325185-b8d9-410c-9da5-2ec5ee09620b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance b381b0d5-3e84-422a-90d7-154041818f09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:58:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:58:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 14:58:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 14:58:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:38 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:40 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:40 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:58:41 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:58:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:58:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:58:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:58:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:58:42 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:58:48 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 14:58:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:58:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:09 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:14 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:14 user nova-compute[71347]: INFO nova.compute.manager [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Terminating instance
Apr 14 14:59:14 user nova-compute[71347]: DEBUG nova.compute.manager [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG nova.compute.manager [req-bf8427d0-c45e-4872-86b6-071de722efcc req-cdf73a5f-c318-465b-99fa-8454063fa61c service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-unplugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:15 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Instance destroyed successfully.
Apr 14 14:59:15 user nova-compute[71347]: DEBUG nova.objects.instance [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'resources' on Instance uuid e8325185-b8d9-410c-9da5-2ec5ee09620b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:53:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469413864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469413864',id=45,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:55:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-tu6wx54m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:57:29Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=e8325185-b8d9-410c-9da5-2ec5ee09620b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "address": "fa:16:3e:e5:8a:da", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e83d513-46", "ovs_interfaceid": "0e83d513-46c5-48cd-bcbe-9ae926f887a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=0e83d513-46c5-48cd-bcbe-9ae926f887a2,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e83d513-46') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_vif [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=0e83d513-46c5-48cd-bcbe-9ae926f887a2,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e83d513-46') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e83d513-46, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:15 user nova-compute[71347]: INFO os_vif [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=0e83d513-46c5-48cd-bcbe-9ae926f887a2,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e83d513-46')
Apr 14 14:59:15 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUSLrGXn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:59:15 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41b479-0a74-4e1e-8057-940917f7ab9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:59:15 user nova-compute[71347]: No targets found.
Apr 14 14:59:15 user nova-compute[71347]: iSNS:
Apr 14 14:59:15 user nova-compute[71347]: No targets found.
Apr 14 14:59:15 user nova-compute[71347]: STATIC:
Apr 14 14:59:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066
Apr 14 14:59:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:59:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:59:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8
Apr 14 14:59:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:59:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:59:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d
Apr 14 14:59:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:59:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:59:15 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 14:59:15 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:59:15 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:59:15 user nova-compute[71347]: FIRMWARE:
Apr 14 14:59:15 user nova-compute[71347]: No targets found.
Apr 14 14:59:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:59:15 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:59:15 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8508f-a6a1-49ee-a1f5-8980d1db8e1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0409eae2-bb46-4cf7-8961-cddefb91a9da]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:59:15 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:59:15 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:59:15 user nova-compute[71347]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)
Apr 14 14:59:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:59:15 user nova-compute[71347]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 (non-flash)
Apr 14 14:59:15 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:59:15 user nova-compute[71347]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)
Apr 14 14:59:15 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4efee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8'): ({'sdd'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Removing single pathed devices sdd {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[62125810-9563-4275-a59c-00286efe5930]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[de83b219-d148-4c58-84d5-b061fc46cbff]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flushing IO for device /dev/sdd {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[224bfdf1-ec21-40fe-a879-c0d5b8667d71]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0011ec-c89d-49c3-8bbc-ce593832efd2]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] SCSI volumes sdd have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a989eecf-d591-4a03-bc99-f5d31278edbd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:59:15 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb3e2b-7f35-42d4-aa29-4cb396d26ab2]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8, portal: 172.16.0.220,3260]
Apr 14 14:59:16 user nova-compute[71347]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8, portal: 172.16.0.220,3260] successful.
Apr 14 14:59:16 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1126918-c0e8-4d10-9e16-96e368a479c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06cfaae-5600-4d58-8e1c-aa6432c37a55]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] <== disconnect_volume: return (309ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:59:16 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Deleting instance files /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b_del
Apr 14 14:59:16 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Deletion of /opt/stack/data/nova/instances/e8325185-b8d9-410c-9da5-2ec5ee09620b_del complete
Apr 14 14:59:16 user nova-compute[71347]: INFO nova.compute.manager [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 14:59:16 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:59:16 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:59:16 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Took 0.58 seconds to deallocate network for instance.
Apr 14 14:59:16 user nova-compute[71347]: DEBUG nova.compute.manager [req-cde7d8d0-39d6-4f55-8298-d6ea50f6069c req-af8f5831-5504-4d4f-9331-d654650bcca1 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-deleted-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG nova.compute.manager [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] Acquiring lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG nova.compute.manager [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] No waiting events found dispatching network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:59:17 user nova-compute[71347]: WARNING nova.compute.manager [req-15830479-871c-4e0c-9228-7a80aeebdff5 req-5b72f5ef-f18b-49f9-8578-787322814917 service nova] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Received unexpected event network-vif-plugged-0e83d513-46c5-48cd-bcbe-9ae926f887a2 for instance with vm_state active and task_state deleting.
Apr 14 14:59:17 user nova-compute[71347]: INFO nova.compute.manager [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Took 0.82 seconds to detach 1 volumes for instance.
Apr 14 14:59:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:59:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:17 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Deleted allocations for instance e8325185-b8d9-410c-9da5-2ec5ee09620b
Apr 14 14:59:17 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-fe8d9fa1-9ba7-4ad4-855d-04a2f89a1d2f tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "e8325185-b8d9-410c-9da5-2ec5ee09620b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:20 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:24 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:59:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:59:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:59:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:59:25 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-changed-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:59:27 user nova-compute[71347]: DEBUG nova.compute.manager [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Refreshing instance network info cache due to event network-changed-fa812b04-be77-4793-92ba-dd4550d6a682. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:59:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] Acquiring lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:59:27 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] Acquired lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:59:27 user nova-compute[71347]: DEBUG nova.network.neutron [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Refreshing network info cache for port fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updated VIF entry in instance network info cache for port fa812b04-be77-4793-92ba-dd4550d6a682. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG nova.network.neutron [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updating instance_info_cache with network_info: [{"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ada4f450-d0d7-4af4-abe1-d7ce6232bb51 req-0229be05-a5f4-4eee-ad9f-b74baa85b196 service nova] Releasing lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "b381b0d5-3e84-422a-90d7-154041818f09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "b381b0d5-3e84-422a-90d7-154041818f09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "b381b0d5-3e84-422a-90d7-154041818f09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:28 user nova-compute[71347]: INFO nova.compute.manager [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Terminating instance
Apr 14 14:59:28 user nova-compute[71347]: DEBUG nova.compute.manager [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 14:59:28 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-vif-unplugged-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] Acquiring lock "b381b0d5-3e84-422a-90d7-154041818f09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] No waiting events found dispatching network-vif-unplugged-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-7a3753c8-9a02-4ea7-b5f2-2a02c98ed371 req-a97bfa16-00e7-4976-8da0-9130f8d41a4e service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-vif-unplugged-fa812b04-be77-4793-92ba-dd4550d6a682 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-changed-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.compute.manager [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Refreshing instance network info cache due to event network-changed-fa812b04-be77-4793-92ba-dd4550d6a682. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] Acquiring lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] Acquired lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Refreshing network info cache for port fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 14:59:29 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Instance destroyed successfully.
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.objects.instance [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'resources' on Instance uuid b381b0d5-3e84-422a-90d7-154041818f09 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-506145245',display_name='tempest-TestVolumeBootPattern-server-506145245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-506145245',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-s370tojs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:57:47Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=b381b0d5-3e84-422a-90d7-154041818f09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=fa812b04-be77-4793-92ba-dd4550d6a682,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa812b04-be') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_vif [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=fa812b04-be77-4793-92ba-dd4550d6a682,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa812b04-be') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa812b04-be, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:59:29 user nova-compute[71347]: INFO os_vif [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:f1:b9,bridge_name='br-int',has_traffic_filtering=True,id=fa812b04-be77-4793-92ba-dd4550d6a682,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa812b04-be')
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoBTRxAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 14:59:29 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce743de1-bd07-42c2-88ad-40b04acca63d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 14:59:29 user nova-compute[71347]: No targets found.
Apr 14 14:59:29 user nova-compute[71347]: iSNS:
Apr 14 14:59:29 user nova-compute[71347]: No targets found.
Apr 14 14:59:29 user nova-compute[71347]: STATIC:
Apr 14 14:59:29 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066
Apr 14 14:59:29 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:59:29 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:59:29 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d
Apr 14 14:59:29 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:59:29 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:59:29 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 14:59:29 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 14:59:29 user nova-compute[71347]:                 Iface Name: default
Apr 14 14:59:29 user nova-compute[71347]: FIRMWARE:
Apr 14 14:59:29 user nova-compute[71347]: No targets found.
Apr 14 14:59:29 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 14:59:29 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 14:59:29 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c0043a-5b82-453e-a266-3d58f1edd915]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6690a3d-154e-41b0-b991-cdd52b293bdd]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:59:29 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:59:29 user nova-compute[71347]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)
Apr 14 14:59:29 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 14:59:29 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 14:59:29 user nova-compute[71347]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d (non-flash)
Apr 14 14:59:29 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd82212d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d'): ({'sde'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Removing single pathed devices sde {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daa2673-8d2d-48b0-8d00-b0042c9ec204]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ae8ed6-7a92-4a1a-948a-53390c248e26]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flushing IO for device /dev/sde {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.025s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e563fe-6f06-4510-8e86-4fc8ca4b046a]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updated VIF entry in instance network info cache for port fa812b04-be77-4793-92ba-dd4550d6a682. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.network.neutron [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updating instance_info_cache with network_info: [{"id": "fa812b04-be77-4793-92ba-dd4550d6a682", "address": "fa:16:3e:58:f1:b9", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa812b04-be", "ovs_interfaceid": "fa812b04-be77-4793-92ba-dd4550d6a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-e485ff12-5743-4ca4-8830-24efc4349c0c req-f5b0393b-72e6-4607-8b67-71977b1e19e2 service nova] Releasing lock "refresh_cache-b381b0d5-3e84-422a-90d7-154041818f09" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8fe016-16cf-433c-b2f8-38880936dd2f]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] SCSI volumes sde have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e420d2c0',) {{(pid=82022) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de356c-600e-45d1-bb6d-019005235afc]: (4, None) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcfdeb5-fa47-43d1-85d7-cb1584d89d35]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d9519f-3252-49cc-9abd-6b6b94022011]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d, portal: 172.16.0.220,3260]
Apr 14 14:59:29 user nova-compute[71347]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d, portal: 172.16.0.220,3260] successful.
Apr 14 14:59:29 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813cbaf0-f5d6-4da5-9c67-816f8c1e417d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e40c8a-349a-4ed3-83be-489eabb283fb]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== disconnect_volume: return (334ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 14:59:29 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Deleting instance files /opt/stack/data/nova/instances/b381b0d5-3e84-422a-90d7-154041818f09_del
Apr 14 14:59:29 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Deletion of /opt/stack/data/nova/instances/b381b0d5-3e84-422a-90d7-154041818f09_del complete
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 14:59:29 user nova-compute[71347]: INFO nova.compute.manager [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: b381b0d5-3e84-422a-90d7-154041818f09] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 14:59:29 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 14:59:30 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681484355.715958, e8325185-b8d9-410c-9da5-2ec5ee09620b => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:59:30 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] VM Stopped (Lifecycle Event)
Apr 14 14:59:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-894ca28b-7c64-4043-af1e-23ed81ecee1a None None] [instance: e8325185-b8d9-410c-9da5-2ec5ee09620b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:59:30 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:59:30 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Took 0.83 seconds to deallocate network for instance.
Apr 14 14:59:30 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Updating instance_info_cache with network_info: [{"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 14:59:30 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-56e1230b-ac3c-4234-96ff-c3731f7b8218" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 14:59:30 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] Acquiring lock "b381b0d5-3e84-422a-90d7-154041818f09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] Lock "b381b0d5-3e84-422a-90d7-154041818f09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] No waiting events found dispatching network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 14:59:31 user nova-compute[71347]: WARNING nova.compute.manager [req-8c94e864-eae0-4ed8-bf8d-f46a2a8e64df req-591797da-d04a-42b5-be23-341a2813abc1 service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received unexpected event network-vif-plugged-fa812b04-be77-4793-92ba-dd4550d6a682 for instance with vm_state active and task_state deleting.
Apr 14 14:59:31 user nova-compute[71347]: DEBUG nova.compute.manager [req-7bb38212-d1d2-4f99-87dd-395f0980ff1a req-8bb93246-6c73-4b46-8eae-5a3dbfbe975c service nova] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Received event network-vif-deleted-fa812b04-be77-4793-92ba-dd4550d6a682 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 14:59:31 user nova-compute[71347]: INFO nova.compute.manager [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Took 0.79 seconds to detach 1 volumes for instance.
Apr 14 14:59:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:59:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:31 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Deleted allocations for instance b381b0d5-3e84-422a-90d7-154041818f09
Apr 14 14:59:31 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-b7d86b18-7820-4d46-8288-5ad4731c379d tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "b381b0d5-3e84-422a-90d7-154041818f09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.239s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:32 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:32 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:32 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 14:59:33 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 14:59:34 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:59:34 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8532MB free_disk=26.150409698486328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 56e1230b-ac3c-4234-96ff-c3731f7b8218 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 14:59:34 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:38 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:41 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:42 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 14:59:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:44 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681484369.4587092, b381b0d5-3e84-422a-90d7-154041818f09 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 14:59:44 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: b381b0d5-3e84-422a-90d7-154041818f09] VM Stopped (Lifecycle Event)
Apr 14 14:59:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-838de852-8fdb-4083-829d-37298fcd6298 None None] [instance: b381b0d5-3e84-422a-90d7-154041818f09] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 14:59:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:59:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:59:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:59:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:59:44 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:49 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:59:51 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 14:59:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 14:59:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 14:59:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:59:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 14:59:54 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 14:59:59 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:04 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:05 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:05 user nova-compute[71347]: INFO nova.compute.manager [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Terminating instance
Apr 14 15:00:05 user nova-compute[71347]: DEBUG nova.compute.manager [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:00:05 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-unplugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] No waiting events found dispatching network-vif-unplugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.compute.manager [req-d1537ebd-d40f-4a8c-9e3e-5e38b0fb4ccb req-7df6f99b-0e75-463f-b345-4d303c7086ec service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-unplugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Instance destroyed successfully.
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.objects.instance [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'resources' on Instance uuid 56e1230b-ac3c-4234-96ff-c3731f7b8218 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-170009530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-170009530',id=43,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:50:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-nob0bvvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:52:40Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=56e1230b-ac3c-4234-96ff-c3731f7b8218,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "address": "fa:16:3e:f3:70:1e", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08093479-30", "ovs_interfaceid": "08093479-30c5-4e51-a7fd-5e6e1a3382b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:70:1e,bridge_name='br-int',has_traffic_filtering=True,id=08093479-30c5-4e51-a7fd-5e6e1a3382b6,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08093479-30') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG os_vif [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:70:1e,bridge_name='br-int',has_traffic_filtering=True,id=08093479-30c5-4e51-a7fd-5e6e1a3382b6,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08093479-30') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08093479-30, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:06 user nova-compute[71347]: INFO os_vif [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:70:1e,bridge_name='br-int',has_traffic_filtering=True,id=08093479-30c5-4e51-a7fd-5e6e1a3382b6,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08093479-30')
Apr 14 15:00:06 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Deleting instance files /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218_del
Apr 14 15:00:06 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Deletion of /opt/stack/data/nova/instances/56e1230b-ac3c-4234-96ff-c3731f7b8218_del complete
Apr 14 15:00:06 user nova-compute[71347]: INFO nova.compute.manager [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 14 15:00:06 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:06 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:07 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:00:07 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Took 1.16 seconds to deallocate network for instance.
Apr 14 15:00:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:07 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:00:07 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:00:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:07 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Deleted allocations for instance 56e1230b-ac3c-4234-96ff-c3731f7b8218
Apr 14 15:00:07 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-86f2d518-b2c8-483e-8b40-7bfb15525c9c tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.187s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] No waiting events found dispatching network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:08 user nova-compute[71347]: WARNING nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received unexpected event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance with vm_state deleted and task_state None.
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] No waiting events found dispatching network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:08 user nova-compute[71347]: WARNING nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received unexpected event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance with vm_state deleted and task_state None.
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] No waiting events found dispatching network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:08 user nova-compute[71347]: WARNING nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received unexpected event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance with vm_state deleted and task_state None.
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-unplugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] No waiting events found dispatching network-vif-unplugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:08 user nova-compute[71347]: WARNING nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received unexpected event network-vif-unplugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance with vm_state deleted and task_state None.
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Acquiring lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] Lock "56e1230b-ac3c-4234-96ff-c3731f7b8218-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] No waiting events found dispatching network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:08 user nova-compute[71347]: WARNING nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received unexpected event network-vif-plugged-08093479-30c5-4e51-a7fd-5e6e1a3382b6 for instance with vm_state deleted and task_state None.
Apr 14 15:00:08 user nova-compute[71347]: DEBUG nova.compute.manager [req-6b9597cf-33f8-4c77-84f0-96681b63525e req-a2d042d6-3c0d-4bcb-bc9b-1e4ef76e00cb service nova] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Received event network-vif-deleted-08093479-30c5-4e51-a7fd-5e6e1a3382b6 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:11 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:00:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:00:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:00:16 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:21 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681484406.3683963, 56e1230b-ac3c-4234-96ff-c3731f7b8218 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:00:21 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] VM Stopped (Lifecycle Event)
Apr 14 15:00:21 user nova-compute[71347]: DEBUG nova.compute.manager [None req-897f5f66-f464-4fe2-808f-3e9d7faa86c2 None None] [instance: 56e1230b-ac3c-4234-96ff-c3731f7b8218] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:00:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:00:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:00:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:00:21 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-changed-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Refreshing instance network info cache due to event network-changed-7f1eaba2-b235-4c56-bc36-cf1821bf51b4. {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] Acquiring lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] Acquired lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Refreshing network info cache for port 7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:26 user nova-compute[71347]: INFO nova.compute.manager [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Terminating instance
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.compute.manager [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-vif-unplugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] Acquiring lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] No waiting events found dispatching network-vif-unplugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e1e1194-515d-4190-9e65-7d8dcaf220c3 req-1d232a75-583a-471e-acf8-a92c890855f9 service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-vif-unplugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updated VIF entry in instance network info cache for port 7f1eaba2-b235-4c56-bc36-cf1821bf51b4. {{(pid=71347) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG nova.network.neutron [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updating instance_info_cache with network_info: [{"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-0b45a8b2-4f04-4968-8cec-a37943bc1754 req-ecfdd236-2aed-4a18-b66b-da7c7899521c service nova] Releasing lock "refresh_cache-48b4950e-98c1-41b1-b578-7c2d2ddddc3d" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:00:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:27 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Instance destroyed successfully.
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.objects.instance [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lazy-loading 'resources' on Instance uuid 48b4950e-98c1-41b1-b578-7c2d2ddddc3d {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-585640922',display_name='tempest-TestVolumeBootPattern-server-585640922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-585640922',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGAWqLrl4HeDxLaf+jZCDgZNz5NvAefKBOsbrPPQCiILJBMcWTXxXoLVGw4GFpBLUEctxJ72EK1AuoONQHY6ZwKmILae/wEA/OVynmNDo2ahW22MAA2MwJBkUBVswrFvA==',key_name='tempest-TestVolumeBootPattern-816706035',keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:55:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e217ba6818e94879aa02015ccf21b058',ramdisk_id='',reservation_id='r-c3662wia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-152189831',owner_user_name='tempest-TestVolumeBootPattern-152189831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:55:47Z,user_data=None,user_id='43b5d8526a7c4b0fb5f15a8345b229e2',uuid=48b4950e-98c1-41b1-b578-7c2d2ddddc3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converting VIF {"id": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "address": "fa:16:3e:07:6f:96", "network": {"id": "6a61e399-feba-4459-a235-1ed131fcfcb1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-233937246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e217ba6818e94879aa02015ccf21b058", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1eaba2-b2", "ovs_interfaceid": "7f1eaba2-b235-4c56-bc36-cf1821bf51b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=7f1eaba2-b235-4c56-bc36-cf1821bf51b4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1eaba2-b2') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_vif [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=7f1eaba2-b235-4c56-bc36-cf1821bf51b4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1eaba2-b2') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f1eaba2-b2, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:27 user nova-compute[71347]: INFO os_vif [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:6f:96,bridge_name='br-int',has_traffic_filtering=True,id=7f1eaba2-b235-4c56-bc36-cf1821bf51b4,network=Network(6a61e399-feba-4459-a235-1ed131fcfcb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1eaba2-b2')
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWqJOlEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:00:27 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0dfc74-5400-452b-8132-1c519cc0f235]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:00:27 user nova-compute[71347]: No targets found.
Apr 14 15:00:27 user nova-compute[71347]: iSNS:
Apr 14 15:00:27 user nova-compute[71347]: No targets found.
Apr 14 15:00:27 user nova-compute[71347]: STATIC:
Apr 14 15:00:27 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066
Apr 14 15:00:27 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:00:27 user nova-compute[71347]:                 Iface Name: default
Apr 14 15:00:27 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 15:00:27 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:00:27 user nova-compute[71347]:                 Iface Name: default
Apr 14 15:00:27 user nova-compute[71347]: FIRMWARE:
Apr 14 15:00:27 user nova-compute[71347]: No targets found.
Apr 14 15:00:27 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:00:27 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:00:27 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5320b1f5-6216-4905-852d-a068f4e78c18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d9d095-ef18-439d-8bd6-49adeeb2463a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 15:00:27 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 15:00:27 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 15:00:27 user nova-compute[71347]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 (non-flash)
Apr 14 15:00:27 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fd8221d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066'): ({'sdb'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Removing single pathed devices sdb {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1001012a-cc25-4df1-a1e1-5ccd698b7354]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b6741-b14c-4f0c-821e-32b30d880be3]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Flushing IO for device /dev/sdb {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0574c92c-b127-4125-a4c3-1eb70e9f23cb]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[448021a4-8a97-42d1-9a32-7c86ce1b0c08]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] SCSI volumes sdb have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6b671e82-5daa2fd029e5e02b', '/dev/disk/by-id/scsi-23564616132666430', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6b671e82') {{(pid=82022) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c209e5fa-1c42-4b9e-856e-8f23fb3441b5]: (4, None) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[592b3554-41de-485d-9742-e62d8d0bf345]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddff5bd-0704-4bdf-a97f-421bb7dd2629]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260]
Apr 14 15:00:27 user nova-compute[71347]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066, portal: 172.16.0.220,3260] successful.
Apr 14 15:00:27 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0e09208-c40e-4eee-b7e7-bd45c326e066 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd37c2d-82b5-4659-b945-1bb45af5a0a4]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] <== disconnect_volume: return (302ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:00:27 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Deleting instance files /opt/stack/data/nova/instances/48b4950e-98c1-41b1-b578-7c2d2ddddc3d_del
Apr 14 15:00:27 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Deletion of /opt/stack/data/nova/instances/48b4950e-98c1-41b1-b578-7c2d2ddddc3d_del complete
Apr 14 15:00:27 user nova-compute[71347]: INFO nova.compute.manager [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 15:00:27 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:00:27 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:00:27 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Took 0.54 seconds to deallocate network for instance.
Apr 14 15:00:28 user nova-compute[71347]: INFO nova.compute.manager [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Took 0.75 seconds to detach 1 volumes for instance.
Apr 14 15:00:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Acquiring lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] No waiting events found dispatching network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:28 user nova-compute[71347]: WARNING nova.compute.manager [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received unexpected event network-vif-plugged-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 for instance with vm_state active and task_state deleting.
Apr 14 15:00:28 user nova-compute[71347]: DEBUG nova.compute.manager [req-ec27e634-3238-4f4d-b54d-4005a8486a51 req-efd1b850-26b0-4747-8b7e-2ca5ca0ecf5a service nova] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Received event network-vif-deleted-7f1eaba2-b235-4c56-bc36-cf1821bf51b4 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:00:28 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:28 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Deleted allocations for instance 48b4950e-98c1-41b1-b578-7c2d2ddddc3d
Apr 14 15:00:29 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-920978a7-0228-4c8f-bffa-d6c824ea684e tempest-TestVolumeBootPattern-152189831 tempest-TestVolumeBootPattern-152189831-project-member] Lock "48b4950e-98c1-41b1-b578-7c2d2ddddc3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:31 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:00:31 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:00:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:33 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71347) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:00:34 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:00:34 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=26.240814208984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:00:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:36 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:38 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:42 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681484427.0082514, 48b4950e-98c1-41b1-b578-7c2d2ddddc3d => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:00:42 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] VM Stopped (Lifecycle Event)
Apr 14 15:00:42 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c2085895-95b7-4286-87f2-e813a82c8e06 None None] [instance: 48b4950e-98c1-41b1-b578-7c2d2ddddc3d] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:00:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:00:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:00:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:00:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:43 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:00:44 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:00:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:56 user nova-compute[71347]: INFO nova.compute.manager [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Terminating instance
Apr 14 15:00:56 user nova-compute[71347]: DEBUG nova.compute.manager [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:56 user nova-compute[71347]: DEBUG nova.compute.manager [req-9e45b224-b664-4074-94eb-b6bcc86c0518 req-841d6a64-fb76-4763-8524-1677a77c1e2d service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:57 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Instance destroyed successfully.
Apr 14 15:00:57 user nova-compute[71347]: DEBUG nova.objects.instance [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'resources' on Instance uuid 43bcfbdd-5fc4-4c83-8d67-f660404766b2 {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-437168363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-437168363',id=40,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-iqodiw6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:48:57Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=43bcfbdd-5fc4-4c83-8d67-f660404766b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "f9319e65-c182-46c2-8bed-b519138df9fc", "address": "fa:16:3e:ee:e7:54", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9319e65-c1", "ovs_interfaceid": "f9319e65-c182-46c2-8bed-b519138df9fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:e7:54,bridge_name='br-int',has_traffic_filtering=True,id=f9319e65-c182-46c2-8bed-b519138df9fc,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9319e65-c1') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_vif [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:e7:54,bridge_name='br-int',has_traffic_filtering=True,id=f9319e65-c182-46c2-8bed-b519138df9fc,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9319e65-c1') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9319e65-c1, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:00:57 user nova-compute[71347]: INFO os_vif [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:e7:54,bridge_name='br-int',has_traffic_filtering=True,id=f9319e65-c182-46c2-8bed-b519138df9fc,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9319e65-c1')
Apr 14 15:00:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] calling os-brick to detach iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4fb4f5c160>, {'target_iqn': 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XabYsycZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:00:57 user nova-compute[71347]: WARNING os_brick.initiator.connectors.base [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9aa01d-0688-4501-a423-f5a176e9cc62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:00:57 user nova-compute[71347]: No targets found.
Apr 14 15:00:57 user nova-compute[71347]: iSNS:
Apr 14 15:00:57 user nova-compute[71347]: No targets found.
Apr 14 15:00:57 user nova-compute[71347]: STATIC:
Apr 14 15:00:57 user nova-compute[71347]: Target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc
Apr 14 15:00:57 user nova-compute[71347]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:00:57 user nova-compute[71347]:                 Iface Name: default
Apr 14 15:00:57 user nova-compute[71347]: FIRMWARE:
Apr 14 15:00:57 user nova-compute[71347]: No targets found.
Apr 14 15:00:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:00:57 user nova-compute[71347]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:00:57 user nova-compute[71347]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71347) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc', 0)] {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da56a67-2bc1-4ec1-a680-902b45f611f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4de458f-8549-47c3-babb-96f793f149a9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 15:00:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc (non-flash)
Apr 14 15:00:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4fb4a9b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc'): ({'sdc'}, set())}) {{(pid=71347) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Removing single pathed devices sdc {{(pid=71347) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b17ff62-4338-461a-bced-d8d68b30b8a3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d544b68-a2ec-49d9-b67e-2b13712640cf]: (4, ('ok\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Flushing IO for device /dev/sdc {{(pid=71347) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75a21af-333b-4267-ba41-f4a5334aa1fd]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71347) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e0a18d-0195-4dfe-b869-6f5d4ac52010]: (4, ('1', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.linuxscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] SCSI volumes sdc have been removed. {{(pid=71347) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc')] {{(pid=71347) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9969298-87a3-4bcf-a985-a5e05b56f5c0]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --logout {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f85b47a-df1e-41df-88ed-cbc6b894552e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc, portal: 172.16.0.220,3260]
Apr 14 15:00:57 user nova-compute[71347]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc, portal: 172.16.0.220,3260] successful.
Apr 14 15:00:57 user nova-compute[71347]:  stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op delete {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0fce133-81e8-4f8e-b0d7-2e1772dc03bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82022) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b0a86e-29f4-4ad4-a59e-3d20a4458976]: (4, ('', '')) {{(pid=82022) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71347) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.base [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG os_brick.initiator.connectors.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] <== disconnect_volume: return (290ms) None {{(pid=71347) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG nova.virt.libvirt.volume.iscsi [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Disconnected iSCSI Volume {{(pid=71347) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:00:57 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Deleting instance files /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2_del
Apr 14 15:00:57 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Deletion of /opt/stack/data/nova/instances/43bcfbdd-5fc4-4c83-8d67-f660404766b2_del complete
Apr 14 15:00:57 user nova-compute[71347]: INFO nova.compute.manager [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 14 15:00:57 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:00:58 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Took 1.12 seconds to deallocate network for instance.
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:58 user nova-compute[71347]: WARNING nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state deleting.
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:58 user nova-compute[71347]: WARNING nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state deleting.
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:58 user nova-compute[71347]: WARNING nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state deleting.
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-unplugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Acquiring lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] No waiting events found dispatching network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:00:58 user nova-compute[71347]: WARNING nova.compute.manager [req-57af5325-71ef-44a1-bc08-193d7403d4ce req-4cc91b62-7f51-4eb1-99ff-1a37567d9152 service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received unexpected event network-vif-plugged-f9319e65-c182-46c2-8bed-b519138df9fc for instance with vm_state active and task_state deleting.
Apr 14 15:00:58 user nova-compute[71347]: DEBUG nova.compute.manager [req-5b2116b6-b266-4a9a-aff5-745fba1e917d req-666f4b70-5b7f-4b03-90fe-f63f8f04125e service nova] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Received event network-vif-deleted-f9319e65-c182-46c2-8bed-b519138df9fc {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:00:59 user nova-compute[71347]: INFO nova.compute.manager [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 15:00:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:00:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:00:59 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:00:59 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:00:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:00:59 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Deleted allocations for instance 43bcfbdd-5fc4-4c83-8d67-f660404766b2
Apr 14 15:00:59 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-417b8c7c-a714-4401-9081-85d3dbf192a1 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "43bcfbdd-5fc4-4c83-8d67-f660404766b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.493s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:01:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:01:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:12 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681484457.1087947, 43bcfbdd-5fc4-4c83-8d67-f660404766b2 => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:01:12 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] VM Stopped (Lifecycle Event)
Apr 14 15:01:12 user nova-compute[71347]: DEBUG nova.compute.manager [None req-c8d51785-e4f2-4aae-a2fd-ec06aec0bead None None] [instance: 43bcfbdd-5fc4-4c83-8d67-f660404766b2] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:01:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:01:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:01:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:23 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:26 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:26 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:01:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:33 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:01:33 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:01:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:01:33 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquired lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:01:33 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Forcefully refreshing network info cache for instance {{(pid=71347) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:01:33 user nova-compute[71347]: DEBUG nova.objects.instance [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lazy-loading 'info_cache' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:01:34 user nova-compute[71347]: DEBUG nova.network.neutron [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [{"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:01:34 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Releasing lock "refresh_cache-2bf7382e-7ffd-4f89-8b79-e8616462c61b" {{(pid=71347) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:01:34 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updated the network info_cache for instance {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:01:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:01:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:01:35 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:01:35 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG oslo_concurrency.processutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71347) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:01:36 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:01:36 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:01:36 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=26.239227294921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71347) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:01:36 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:01:37 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:01:37 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:01:37 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:01:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:01:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:38 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:40 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:01:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:44 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:44 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:01:46 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:01:47 user nova-compute[71347]: INFO nova.compute.manager [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Terminating instance
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.compute.manager [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Start destroying the instance on the hypervisor. {{(pid=71347) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received event network-vif-unplugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] No waiting events found dispatching network-vif-unplugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.compute.manager [req-cb563e40-011c-46dd-a475-cb447ef43fbd req-e94b9d4d-da1f-40a6-a628-4670aff5d5e9 service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received event network-vif-unplugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance with task_state deleting. {{(pid=71347) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:01:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [-] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Instance destroyed successfully.
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.objects.instance [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lazy-loading 'resources' on Instance uuid 2bf7382e-7ffd-4f89-8b79-e8616462c61b {{(pid=71347) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.virt.libvirt.vif [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T14:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-682419594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-682419594',id=38,image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T14:42:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2241300ad3704734aed3990cc7aadc1b',ramdisk_id='',reservation_id='r-og0u4y0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='79416463-b265-4588-8d03-bcb84f0ecc83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T14:44:08Z,user_data=None,user_id='2e321f85d3d44c2baf210a1962f4f08f',uuid=2bf7382e-7ffd-4f89-8b79-e8616462c61b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converting VIF {"id": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "address": "fa:16:3e:29:1f:ea", "network": {"id": "8257c570-6815-4a7d-b7f5-dfb76e8c0263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-237759131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2241300ad3704734aed3990cc7aadc1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e411066-1a", "ovs_interfaceid": "3e411066-1ad2-4ba8-a60e-ad0c8cea8a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.network.os_vif_util [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:1f:ea,bridge_name='br-int',has_traffic_filtering=True,id=3e411066-1ad2-4ba8-a60e-ad0c8cea8a40,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e411066-1a') {{(pid=71347) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG os_vif [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:1f:ea,bridge_name='br-int',has_traffic_filtering=True,id=3e411066-1ad2-4ba8-a60e-ad0c8cea8a40,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e411066-1a') {{(pid=71347) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e411066-1a, bridge=br-int, if_exists=True) {{(pid=71347) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:01:47 user nova-compute[71347]: INFO os_vif [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:1f:ea,bridge_name='br-int',has_traffic_filtering=True,id=3e411066-1ad2-4ba8-a60e-ad0c8cea8a40,network=Network(8257c570-6815-4a7d-b7f5-dfb76e8c0263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e411066-1a')
Apr 14 15:01:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Deleting instance files /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b_del
Apr 14 15:01:47 user nova-compute[71347]: INFO nova.virt.libvirt.driver [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Deletion of /opt/stack/data/nova/instances/2bf7382e-7ffd-4f89-8b79-e8616462c61b_del complete
Apr 14 15:01:47 user nova-compute[71347]: INFO nova.compute.manager [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Took 0.75 seconds to destroy the instance on the hypervisor.
Apr 14 15:01:47 user nova-compute[71347]: DEBUG oslo.service.loopingcall [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71347) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.compute.manager [-] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Deallocating network for instance {{(pid=71347) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:01:47 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] deallocate_for_instance() {{(pid=71347) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:01:48 user nova-compute[71347]: DEBUG nova.network.neutron [-] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Updating instance_info_cache with network_info: [] {{(pid=71347) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:01:48 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Took 0.60 seconds to deallocate network for instance.
Apr 14 15:01:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:01:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:01:48 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:01:48 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:01:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:01:48 user nova-compute[71347]: INFO nova.scheduler.client.report [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Deleted allocations for instance 2bf7382e-7ffd-4f89-8b79-e8616462c61b
Apr 14 15:01:48 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-9ec0aa18-3cf6-4200-8509-8afaa5cd87d9 tempest-ServerBootFromVolumeStableRescueTest-2086147649 tempest-ServerBootFromVolumeStableRescueTest-2086147649-project-member] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.642s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:01:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received event network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:01:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Acquiring lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:01:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:01:49 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] Lock "2bf7382e-7ffd-4f89-8b79-e8616462c61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:01:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] No waiting events found dispatching network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:01:49 user nova-compute[71347]: WARNING nova.compute.manager [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received unexpected event network-vif-plugged-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 for instance with vm_state deleted and task_state None.
Apr 14 15:01:49 user nova-compute[71347]: DEBUG nova.compute.manager [req-3a2f3925-e55d-4ca9-9570-e29613108e42 req-9fc63756-d7e2-47ed-8d60-cd659c9a4e3d service nova] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Received event network-vif-deleted-3e411066-1ad2-4ba8-a60e-ad0c8cea8a40 {{(pid=71347) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:01:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:01:54 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:01:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:02 user nova-compute[71347]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681484507.8062549, 2bf7382e-7ffd-4f89-8b79-e8616462c61b => Stopped> {{(pid=71347) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:02:02 user nova-compute[71347]: INFO nova.compute.manager [-] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] VM Stopped (Lifecycle Event)
Apr 14 15:02:02 user nova-compute[71347]: DEBUG nova.compute.manager [None req-f957bbc2-61ac-4df1-9723-eea2f5ee7cb3 None None] [instance: 2bf7382e-7ffd-4f89-8b79-e8616462c61b] Checking state {{(pid=71347) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:02:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:02:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:28 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:02:35 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:02:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:02:35 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:02:36 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:02:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:02:36 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:02:36 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:02:37 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:02:37 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:02:37 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=26.322341918945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:02:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:02:38 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:38 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:39 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:40 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:42 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:44 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:44 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:02:45 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:02:48 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:02:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:02:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:03:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:03:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71347) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:03:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:03:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71347) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:03:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:12 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:17 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:22 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:27 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:30 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:32 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:36 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Starting heal instance info cache {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:03:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Rebuilding the list of instances to heal {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:03:36 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Didn't find any instances for network info cache update. {{(pid=71347) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:03:37 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:03:37 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:37 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:03:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:03:37 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:03:37 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Auditing locally available compute resources for user (node: user) {{(pid=71347) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:03:38 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:03:38 user nova-compute[71347]: WARNING nova.virt.libvirt.driver [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=26.31917953491211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71347) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71347) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing inventories for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating ProviderTree inventory for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Updating inventory in ProviderTree for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing aggregate associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, aggregates: None {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Refreshing trait associations for resource provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000 {{(pid=71347) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.compute.provider_tree [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed in ProviderTree for provider: a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c {{(pid=71347) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.scheduler.client.report [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Inventory has not changed for provider a47ee6f0-70d7-4ae6-bc3f-fa4a43a11e3c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71347) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG nova.compute.resource_tracker [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Compute_service record updated for user:user {{(pid=71347) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:03:38 user nova-compute[71347]: DEBUG oslo_concurrency.lockutils [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=71347) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:03:39 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:42 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:43 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:45 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 15:03:45 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] There are 0 instances to clean {{(pid=71347) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 15:03:46 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:46 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71347) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:03:47 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:47 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:03:50 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:50 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:52 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:03:52 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:52 user nova-compute[71347]: DEBUG nova.compute.manager [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71347) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 15:03:54 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:55 user nova-compute[71347]: DEBUG oslo_service.periodic_task [None req-0eb19cdd-50b5-4a67-a982-a52a9a790a34 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71347) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:03:57 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:04:02 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:04:07 user nova-compute[71347]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71347) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}